Playing fast and loose with music recognition

Greenhalgh, Chris; Benford, Steve; Hazzard, Adrian; Chamberlain, Alan

Abstract

We report lessons from iteratively developing a music recognition system to enable a wide range of musicians to embed musical codes into their typical performance practice. The musician composes fragments of music that can be played back with varying levels of embellishment, disguise and looseness to trigger digital interactions. We collaborated with twenty-three musicians, spanning professionals to amateurs and working with a variety of instruments. We chart the rapid evolution of the system to meet their needs as they strove to integrate music recognition technology into their performance practice, introducing multiple features to enable them to trade-off reliability with musical expression. Collectively, these support the idea of deliberately introducing ‘looseness’ into interactive systems by addressing the three key challenges of control, feedback and attunement, and highlight the potential role for written notations in other recognition-based systems.

Citation

Greenhalgh, C., Benford, S., Hazzard, A., & Chamberlain, A. Playing fast and loose with music recognition. Presented at CHI 2017: ACM CHI Conference on Human Factors in Computing Systems

• Conference Name: CHI 2017: ACM CHI Conference on Human Factors in Computing Systems
• End Date: May 11, 2017
• Acceptance Date: Jan 16, 2017
• Publication Date: May 2, 2017
• Deposit Date: Apr 10, 2017
• Publicly Available Date: May 2, 2017
• Peer Reviewed: Peer Reviewed
• Keywords: Music recognition; notation; sensing systems; looseness; performance; H-metaphor; casual interactions; attunement
• Public URL: https://nottingham-repository.worktribe.com/output/858375
• Publisher URL: http://dl.acm.org/citation.cfm?doid=3025453.3025900
• Related Public URLs: https://chi2017.acm.org/
• Additional Information: doi:10.1145/3025453.3025900. CHI '17 Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems.
• Contract Date: Apr 10, 2017