MappEMG consists of a data pipeline that uses pianists’ core muscle activity captured though surface electromyography (EMG) to produce a vibrotactile feedback. The main objective of the project is to make perceptible through haptic stimuli a rather non-visible dimension of pianists’ gestures: muscle activations related not to motion of body segments but to the embodiment of musical tension, a central feature of musical structure in western tonal music. First developed to be used with the Vibropixels, the pipeline was adapted to produce the vibrotactile feedback with specifically designed Apps (iOS and Android) aiming to control the vibration of smartphones. MappEMG is being used in the context of live musical performances and pedagogical contexts.
- Verdugo, F., Kokubu, S., Wang, J., Wanderley, M. M. (2020). MappEMG: Supporting Musical Expression with Vibrotactile Feedback by Capturing Gestural Features through Electromyography. In Proc. of the International Workshop on Haptic and Audio Interaction Design (HAID). Montreal, Canada.