MappEMG consists of a data pipeline that uses pianists’ core muscle activity captured though surface electromyography (EMG) to produce a vibrotactile feedback. The main objective of the project is to make perceptible through haptic stimuli a rather non-visible dimension of pianists’ gestures: muscle activations related not to motion of body segments but to the embodiment of musical tension, a central feature of musical structure in western tonal music. First developed to be used with the Vibropixels, we are currently adapting the pipeline to produce the vibrotactile feedback with a specifically designed App aiming to control the vibration of smartphones. We envision to use the MappEMG in the context of both live musical performances and instrumental lessons.
- Verdugo, F., Kokubu, S., Wang, J., Wanderley, M. M. (2020). MappEMG: Supporting Musical Expression with Vibrotactile Feedback by Capturing Gestural Features through Electromyography. In Proc. of the International Workshop on Haptic and Audio Interaction Design (HAID). Montreal, Canada.