Jess+: AI and robotics with inclusive music-making

Vear, Craig; Hazzard, Adrian; Moroz, Solomiya; Benerradi, Johann

Abstract

This paper discusses the findings from a cross-sector research project investigating how a digital score created using AI and robotics might stimulate new creative opportunities and relationships within the practices of an inclusive music ensemble. Through the concept of a digital score [65], AI and a robotic arm were introduced into an ensemble's musical practice to evaluate the impact and benefits of using autonomous systems to challenge barriers around a disabled musician's access to creative music-making. Throughout the development process we placed an emphasis on involvement and togetherness of not only the AI and robots' contribution to shared creativity amongst the ensemble, but also to the social aspects of the creative process across the team of musicians, developers, researchers and supporting organisations. The findings were surprising with many aspects of the project exceeding the expectations of the original aims. In short, all the musicians benefited from the introduction of these unfamiliar technologies with practices enhanced and relationships transformed.

Citation

Vear, C., Hazzard, A., Moroz, S., & Benerradi, J. (2024, May). Jess+: AI and robotics with inclusive music-making. Presented at CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, Honalulu, Hawaii

• Presentation Conference Type: Edited Proceedings
• Conference Name: CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems
• Start Date: May 11, 2024
• End Date: May 16, 2024
• Acceptance Date: Feb 5, 2024
• Online Publication Date: May 11, 2024
• Publication Date: May 11, 2024
• Deposit Date: Feb 6, 2024
• Publicly Available Date: May 11, 2024
• Publisher: Association for Computing Machinery (ACM)
• Peer Reviewed: Peer Reviewed
• Article Number: 33
• Pages: 1-17
• Book Title: CHI '24: Proceedings of the CHI Conference on Human Factors in Computing Systems
• ISBN: 9798400703300
• DOI: https://doi.org/10.1145/3613904.3642548
• Keywords: CCS Concepts: • Human-centered computing → Collaborative and social computing devices Additional Key Words and Phrases: Embodied AI; neural networks; robotics; music-making; creativity; digital score
• Public URL: https://nottingham-repository.worktribe.com/output/31145998
• Publisher URL: https://dl.acm.org/doi/10.1145/3613904.3642548
• Related Public URLs: https://chi2024.acm.org/
• Additional Information: Published: 2024-05-11