Biography:

Co-director, Graphics and Experiential Media (GEM) Lab
Assistant Professor, Faculty of Computer Science, Dalhousie University

Research Statement:

My research focuses on Human Computer Interaction, especially as applied to creative and expressive interaction with digital tools. I create new digital musical instruments (including the T-Stick and the Spine) and intermedia mapping tools (including libmapper and its surrounding ecosystem of tools). I am also interested in appropriating tools and approaches from performative and artistic interaction and applying them to human-computer activities that are normally considered to be prosaic such as target selection, command invocation, and text entry.

Research Areas:

• Haptics: Tactile and Force-Feedback
• Hardware Development
• Interface Design
• Interface Evaluation
• Mapping
• Sensors
• Software Development

Projects

Publications:

• (2014). Advances in the Design of Mapping for Computer Music. In Computer Music Journal. Wanderley, M. M., Malloch, J. (Eds.). Computer Music Journal, MIT Press.
• Malloch, J., Sinclair, S., Wanderley, M. M. (2018). Generalized Multi-Instance Control Mapping for Interactive Media Systems. In IEEE Multimedia (pp. 39-50).
• Wang, J., Malloch, J., Huot, S., Chevalier, F., Wanderley, M. M. (2017). Versioning and Annotation Support for Collaborative Mapping Design. In Sound and Music Computing.
• Wang, J., Malloch, J., Sinclair, S., Wilansky, J., Krajeski, A., Marcelo Wanderley, a. M. (2019). Webmapper: A Tool for Visualizing and Manipulating Mappings in Digital Musical Instruments. In Proceedings of the 14th International Symposium on Computer Music Multidisciplinary Research (CMMR). Marseille, France.
• Malloch, J., Wanderley, M. M. (2007). The T-Stick : From Musical Interface to Musical Instrument. In Proceedings of the 2007 International Conference on New Interfaces for Musical Expression (NIME 2007) (pp. 66--69). New York City, NY, USA.
• Nieva, A., Wang, J., Malloch, J., Wanderley, M. M. (2018). The T-Stick: Maintaining a 12 year-old digital musical instrument. In Proceedings of the 2018 International Conference on New Interfaces for Musical Expression (NIME 2018) (pp. 198–199). Blacksburg, VA, USA.
• Malloch, J., Sinclair, S., Wanderley, M. M. (2015). Distributed Tools for Interactive Design of Heterogeneous Signal Networks. In Multimedia Tools and Applications (pp. 5683-5707).
• Barbosa, J., Malloch, J., Huot, S., Wanderley, M. M. (2015). What does ‘Evaluation’ mean for the NIME community?. In Proceedings of the 2015 International Conference on New Interfaces for Musical Expression (NIME 2015). Baton Rouge, LA, USA.
• Malloch, J., Garcia, J., Wanderley, M. M., Mackay, W. E., Beaudouin-Lafon, M., Huot, S. (2019). A Design Workbench for Interactive Music Systems. In New Directions in Music and Human-Computer Interaction. (pp. 23-40). Holland, S., Mudd, T., Wilkie-McKenna, K., McPherson, A., Wanderley, M. M. (Eds.). Springer, Cham.
• Malloch, J. (2007). A Consort of Gestural Musical Controllers: Design, Construction, and Performance. In M.A. thesis, McGill University. Montreal, Canada.
• Malloch, J., Sinclair, S., Wanderley, M. M. (2007). From controller to sound: Tools for collaborative development of digital musical instruments. In Proceedings of the 2007 International Computer Music Conference (ICMC2007) (pp. 65–72). Copenhagen, Denmark.
• Malloch, J., Sinclair, S., Wanderley, M. M. (2008). A network-based framework for collaborative development and performance of digital musical instruments. In CMMR 2007, - Proceedings of Computer Music Modeling and Retrieval 2007 Conference, LNCS 4969 (pp. 401–425). Kronland-Martinet, R., Ystad, S., Jensen, K. (Eds.). Springer Verlag.Berlin, Germany.
• Malloch, J. (2013). A Framework and Tools for Mapping of Digital Musical Instruments. In Ph.D. thesis, Music Technology. Montreal, Canada.
• Malloch, J., Wanderley, M. M. (2017). Embodied Cognition and Digital Musical Instruments: Design and Performance. In The Routledge Companion to Embodied Music Interaction (pp. 438–447). Lesaffre, M., Leman, M., Maes, P. (Eds.).
• Frisson, C., Bredholt, M., Malloch, J., Wanderley, M. M. (2021). MapLooper: Live-looping of distributed gesture-to-sound mappings. In Proceedings of the 2021 International Conference on New Interfaces for Musical Expression (NIME 2021). Shanghai, China.
• Calegario, F., Tragtenberg, J., Frisson, C., Meneses, E., Malloch, J., Cusson, V., Wanderley, M. M. (2021). Documentation and Replicability in the NIME Community. In Proceedings of the 2021 International Conference on New Interfaces for Musical Expression (NIME 2021).. Shanghai, China.
• Hattwick, I., Malloch, J., Wanderley, M. M. (2014). Forming Shapes to Bodies: Design for Manufacturing in the Prosthetic Instruments. In Proceedings of the 2014 International Conference on New Interfaces for Musical Expression (NIME 2014) (pp. 443–448). London, UK.
• Malloch, J., Birnbaum, D., Sinyor, E., Wanderley, M. M. (2006). A New Conceptual Framework for Digital Musical Instruments. In Proceedings of the 9th International Conference on Digital Audio Effects (DAFx-06) (pp. 49–52). Montreal, Qc, Canada.
• Boettcher, B., Malloch, J., Wang, J., Wanderley, M. M. (2022). Mapper4Live: Using Control Structures to Embed Complex Mapping Tools into Ableton Live. In New Interfaces for Musical Expression (NIME) 2022.

Contacts:

• Email: jmalloch@dal.ca
• Website: http://www.josephmalloch.com/