Skip to main content

Research Repository

Advanced Search

Improvising a Live Score to an Interactive Brain-Controlled Film

Ramchurn, Richard; Martinez-Avila, Juan; Martindale, Sarah; Chamberlain, Alan; Wilson, Max L; Benford, Steve

Improvising a Live Score to an Interactive Brain-Controlled Film Thumbnail


Richard Ramchurn

Juan Martinez-Avila

Assistant Professor of Digital Innovation in The Creative Industries

Dunford Chair in Computer Science


We report on the design and deployment of systems for the performance of live score accompaniment to an interactive movie by a Networked Musical Ensemble. In this case, the audiovisual content of the movie is selected in real time based on user input to a Brain-Computer Interface (BCI). Our system supports musical improvisation between human performers and automated systems responding to the BCI. We explore the performers' roles during two performances when these socio-technical systems were implemented, in terms of coordination, problem-solving, managing uncertainty and musical responses to system constraints. This allows us to consider how features of these systems and practices might be incorporated into a general tool, aimed at any musician, which could scale for use in different performance settings involving interactive media.


Ramchurn, R., Martinez-Avila, J., Martindale, S., Chamberlain, A., Wilson, M. L., & Benford, S. (2019). Improvising a Live Score to an Interactive Brain-Controlled Film.

Conference Name International Conference on New Interfaces for Musical Expression (NIME)
Conference Location Porto Alegre, Brazil
Start Date Jun 3, 2019
End Date Jun 6, 2019
Acceptance Date Mar 20, 2019
Publication Date Jun 6, 2019
Deposit Date Jun 24, 2019
Publicly Available Date Jun 25, 2019
Keywords Live score, BCI, Film, Improvisation, Max/MSP/Jitter CCS Concepts, Applied computing, Sound and music computing, Performing arts, Information systems, Music retrieval
Public URL
Publisher URL
Related Public URLs


You might also like

Downloadable Citations