Improvising a Live Score to an Interactive Brain-Controlled Film

Ramchurn, Richard; Martinez-Avila, Juan; Martindale, Sarah; Chamberlain, Alan; Wilson, Max L; Benford, Steve

Abstract

We report on the design and deployment of systems for the performance of live score accompaniment to an interactive movie by a Networked Musical Ensemble. In this case, the audiovisual content of the movie is selected in real time based on user input to a Brain-Computer Interface (BCI). Our system supports musical improvisation between human performers and automated systems responding to the BCI. We explore the performers' roles during two performances when these socio-technical systems were implemented, in terms of coordination, problem-solving, managing uncertainty and musical responses to system constraints. This allows us to consider how features of these systems and practices might be incorporated into a general tool, aimed at any musician, which could scale for use in different performance settings involving interactive media.

Citation

Ramchurn, R., Martinez-Avila, J., Martindale, S., Chamberlain, A., Wilson, M. L., & Benford, S. (2019). Improvising a Live Score to an Interactive Brain-Controlled Film.

• Conference Name: International Conference on New Interfaces for Musical Expression (NIME)
• Conference Location: Porto Alegre, Brazil
• Start Date: Jun 3, 2019
• End Date: Jun 6, 2019
• Acceptance Date: Mar 20, 2019
• Publication Date: Jun 6, 2019
• Deposit Date: Jun 24, 2019
• Publicly Available Date: Jun 25, 2019
• Keywords: Live score, BCI, Film, Improvisation, Max/MSP/Jitter CCS Concepts, Applied computing, Sound and music computing, Performing arts, Information systems, Music retrieval
• Public URL: https://nottingham-repository.worktribe.com/output/2223004
• Publisher URL: http://www.nime.org/archives/
• Related Public URLs: https://www.ufrgs.br/nime2019/