MappEMG consists of a data pipeline that uses pianists’ trunk muscle activity captured though surface electromyography (EMG) to produce a vibrotactile feedback. The main objective of the project is to make perceptible through haptic stimuli a rather non-visible dimension of pianists’ gestures: muscle activations related not to motion of body segments but to the embodiment of musical tension, a central feature of musical structure in western tonal music. We envision to use the MappEMG in the context of both live musical performances and instrumental lessons.
- Verdugo, F., Kokubu, S., Wang, J., Wanderley, M.M. (2020). MappEMG: Supporting Musical Expression with Vibrotactile Feedback by Capturing Gestural Features through Electromyography. In Proc. of the International Workshop on Haptic and Audio Interaction Design (HAID). Montreal, Canada.