Alternative Visualization Techniques
Although the spreadsheet-like interface shown above has been used successfully in a number of individual and collaborative projects, there are scenarios in which alternative layouts and interaction techniques may be useful. Since signal names are used to distinguish mapping sources and destinations, this approach lends itself well to mapping scenarios that involve small numbers of devices with heterogeneous parameters-spaces; a scenario that requires mapping of a large number of identical devices (e.g. wireless motes) may confuse the user since the GUI display would be full of entries like this:
The user would likely be better served by a GUI that displayed devices based on their physical location, or the performer’s name if they are worn or hand-held, or perhaps their activity over some specified period of time. To this end, we began exploring alternatives for the network visualization, with the philosophy that no one approach would be appropriate for all users or at all times. Instead, the GUI should allow the user to choose from different views of the mapping network, and even customize and create new views. The data driving the GUI view is supplied by libmapper, which already supports tagging of all entities (devices, signals, connections) with extensible metadata. Prototype versions of the GUI have enabled users to both sort entities using tagged metadata, and to apply new tags.
browsing active devices and their signals
drag-and-drop mapping connections
mode and function editor for connections
filtering parameter lists by OSC prefix or string-matching
saving and loading mapping sets (including consideration of mapping transportability per the GDIF project)
multiple “views” of the mapping network, using different visualization techniques
- Malloch, J., Sinclair, S., Wanderley, M.M. (2015). Distributed Tools for Interactive Design of Heterogeneous Signal Networks. In Multimedia Tools and Applications (pp. 5683-5707).
- Malloch, J. (2013). A Framework and Tools for Mapping of Digital Musical Instruments. In Ph.D. thesis, Music Technology. Montreal, Canada.
- Krajeski, A. (2013). A Flexible Tool for the Visualization of Musical Mapping Networks. In M.A. thesis, McGill University. Montreal, Canada.
- Wilansky, J. (2013). A Production Tool for Analysis of the Mapping Layer in Digital Musical Instruments. In M.A. thesis, McGill University.
- Rudraraju, V. (2011). A Tool for Configuring Mappings for Musical Systems using Wireless Sensor Networks. In M.A. thesis, McGill University. Montreal, Canada.
- Malloch, J., Sinclair, S., Wanderley, M.M. (2008). A network-based framework for collaborative development and performance of digital musical instruments. In Proc. of Computer Music Modeling and Retrieval 2007 Conference (CMMR2007) (pp. 401–425). Berlin, Germany.
- Malloch, J., Sinclair, S., Wanderley, M.M. (2007). From controller to sound: Tools for collaborative development of digital musical instruments. In Proceedings of the 2007 International Computer Music Conference (pp. 65–72). Copenhagen, Denmark.
- Malloch, J. (2007). A Consort of Gestural Musical Controllers: Design, Construction, and Performance. In M.A. thesis, McGill University. Montreal, Canada.