Skip to main content

Research Repository

Advanced Search

The automatic detection of chronic pain-related expression: requirements, challenges and a multimodal dataset

Aung, Min S.H.; Kaltwang, Sebastian; Romera-Paredes, Bernardino; Martinez, Brais; Singh, Aneesha; Cella, Matteo; Valstar, Michel F.; Meng, Hongying; Kemp, Andrew; Shafizadeh, Moshen; Elkins, Aaron; Kanakam, Natalie; Rothschild, Amshal de; Tyler, Nick; Watson, Paul J.; Williams, Amanda C. de C.; Pantic, Maja; Bianchi-Berthouze, Nadia

Authors

Min S.H. Aung

Sebastian Kaltwang

Bernardino Romera-Paredes

Brais Martinez

Aneesha Singh

Matteo Cella

Michel F. Valstar

Hongying Meng

Andrew Kemp

Moshen Shafizadeh

Aaron Elkins

Natalie Kanakam

Amshal de Rothschild

Nick Tyler

Paul J. Watson

Amanda C. de C. Williams

Maja Pantic

Nadia Bianchi-Berthouze



Abstract

Pain-related emotions are a major barrier to effective self rehabilitation in chronic pain. Automated coaching systems capable of detecting these emotions are a potential solution. This paper lays the foundation for the development of such systems by making three contributions. First, through literature reviews, an overview of how chronic pain is expressed and the motivation for detecting it in physical rehabilitation is provided. Second, a fully labelled multimodal dataset containing high resolution multiple-view face videos, head mounted and room audio signals, full body 3-D motion capture and electromyographic signals from back muscles is supplied. Natural unconstrained pain related facial expressions and body movement behaviours were elicited from people with chronic pain carrying out physical exercises. Both instructed and non- instructed exercises where considered to reflect different rehabilitation scenarios. Two sets of labels were assigned: level of pain from facial expressions annotated by eight raters and the occurrence of six pain-related body behaviours segmented by four experts. Third, through exploratory experiments grounded in the data, the factors and challenges in the automated recognition of such expressions and behaviour are described, the paper concludes by discussing potential avenues in the context of these findings also highlighting differences for the two exercise scenarios addressed.

Journal Article Type Article
Publication Date Jul 30, 2015
Journal IEEE Transactions on Affective Computing
Print ISSN 1949-3045
Electronic ISSN 1949-3045
Publisher Institute of Electrical and Electronics Engineers
Peer Reviewed Peer Reviewed
Volume 99
APA6 Citation Aung, M. S., Kaltwang, S., Romera-Paredes, B., Martinez, B., Singh, A., Cella, M., …Bianchi-Berthouze, N. (2015). The automatic detection of chronic pain-related expression: requirements, challenges and a multimodal dataset. IEEE Transactions on Affective Computing, 99, doi:10.1109/TAFFC.2015.2462830
DOI https://doi.org/10.1109/TAFFC.2015.2462830
Keywords Chronic Low Back Pain, Emotion, Pain Behaviour, Body Movement, Facial Expression, Surface Electromyography, Motion Capture, Automatic Emotion Recognition, Multimodal Database
Publisher URL http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=7173007
Copyright Statement Copyright information regarding this work can be found at the following address: http://creativecommons.org/licenses/by/4.0
Additional Information (c)2015 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.

Files

TAC_R1_SUBMISSION_VERSION.pdf (972 Kb)
PDF

Copyright Statement
Copyright information regarding this work can be found at the following address: http://creativecommons.org/licenses/by/4.0





You might also like



Downloadable Citations

;