Automatic Detection of ADHD and ASD from Expressive Behaviour in RGBD Data

Jaiswal, Shashank; Valstar, Michel F.; Gillott, Alinda; Daley, David

Abstract

Attention Deficit Hyperactivity Disorder (ADHD) and Autism Spectrum Disorder (ASD) are neurodevelopmental conditions which impact on a significant number of children and adults. Currently, the diagnosis of such disorders is done by experts who employ standard questionnaires and look for certain behavioural markers through manual observation. Such methods for their diagnosis are not only subjective, difficult to repeat, and costly but also extremely time consuming. In this work, we present a novel methodology to aid diagnostic predictions about the presence/absence of ADHD and ASD by automatic visual analysis of a persons behaviour. To do so, we conduct the questionnaires in a computer-mediated way while recording participants with modern RGBD (Colour+Depth) sensors. In contrast to previous automatic approaches which have focussed only on detecting certain behavioural markers, our approach provides a fully automatic end-to-end system to directly predict ADHD and ASD in adults. Using state of the art facial expression analysis based on Dynamic Deep Learning and 3D analysis of behaviour, we attain classification rates of 96% for Controls vs Condition (ADHD/ASD) groups and 94% for Comorbid (ADHD+ASD) vs ASD only group. We show that our system is a potentially useful time saving contribution to the clinical diagnosis of ADHD and ASD.

Citation

Jaiswal, S., Valstar, M. F., Gillott, A., & Daley, D. (2017, May). Automatic Detection of ADHD and ASD from Expressive Behaviour in RGBD Data. Presented at 12th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2017), Washington, DC, USA

• Conference Name: 12th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2017)
• Start Date: May 30, 2017
• End Date: Jun 3, 2017
• Acceptance Date: Jan 23, 2017
• Online Publication Date: Jun 29, 2017
• Publication Date: 2017
• Deposit Date: Feb 27, 2017
• Publicly Available Date: Jun 29, 2017
• Publisher: Institute of Electrical and Electronics Engineers
• Peer Reviewed: Peer Reviewed
• Pages: 762-769
• Book Title: Proceedings - 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017)
• ISBN: 978-1-5090-4024-7
• DOI: https://doi.org/10.1109/FG.2017.95
• Public URL: https://nottingham-repository.worktribe.com/output/862463
• Publisher URL: https://ieeexplore.ieee.org/document/7961818/
• Additional Information: © 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
• Contract Date: Feb 27, 2017