Video file
Image
Image
Image
Image
Image
Image
Image
Image
Graduates
Munchy Wu
BS in Interaction Design — Interaction DesignCourse:
IXD-360-01 IXD Topic Studio: Inputs
Faculty:
Sheri, Yasaman
Term:
2024 Summer
MIDISONIC_Interactive Music Device
A contactless instrument for musical expression.
An interactive system that turns movement into sound and visual feedback, inspired by the lack of creative tools in rehabilitation settings.
Process:
During a visit to Rancho Los Amigos Rehabilitation Center, I noticed that many assistive products were thoughtfully designed to support mobility and everyday tasks. What I did not see were tools created for creative expression. That gap became the starting point for MIDISONIC.
Initial challenge
The first prototype could map movement to sound, but it offered almost no feedback for users to understand what was happening.
Early testing
Users often felt lost. Because the system responded only through sound, small variations in gesture produced large changes that were difficult to interpret. Without visual feedback, they struggled to connect movement with output.
Making the system legible
I redesigned the mapping logic and paired it with a visual interface in TouchDesigner. By responding in real time to gesture, the visuals made the interaction easier to understand. Users could now hear and see the system at once, which helped them adapt faster and feel more in control.
Learning Outcomes:
Product system
The final form evolved into a modular system for play, portability, and exploration.
By separating sensing modules into stackable parts, MIDISONIC became more adaptable in both use and form. The system supports full-body gestural play, compact portability, and hands-on exploration.
Project Website: