Feel the noise: Mid-air ultrasound haptics as a novel human-vehicle interaction paradigm

Large, David; Harrington, Kyle; Burnett, Gary; Georgiou, Orestis

Abstract

Focussed ultrasound can be used to create the sensation of touch in mid-air. Combined with gestures, this can provide haptic feedback to guide users, thereby overcoming the lack of agency associated with pure gestural interfaces, and reducing the need for vision – it is therefore particularly apropos of the driving domain. In a counter-balanced 2 × 2 driving simulator study, a traditional in-vehicle touchscreen was compared with a virtual mid-air gestural interface, both with and without ultrasound haptics. Forty-eight experienced drivers (28 male, 20 female) undertook representative in-vehicle tasks – discrete target selections and continuous slider-bar manipulations – whilst driving. Results show that haptifying gestures with ultrasound was particularly effective in reducing visual demand (number of long glances and mean off-road glance time), and increasing performance (shortest interaction times, highest number of correct responses and least ‘overshoots’) associated with continuous tasks. In contrast, for discrete, target-selections, the touchscreen enabled the highest accuracy and quickest responses, particularly when combined with haptic feedback to guide interactions, although this also increased visual demand. Subjectively, the gesture interfaces invited higher ratings of arousal compared to the more familiar touch-surface technology, and participants indicated the lowest levels of workload (highest performance, lowest frustration) associated with the gesture-haptics interface. In addition, gestures were preferred by participants for continuous tasks. The study shows practical utility and clear potential for the use of haptified gestures in the automotive domain.

Citation

Large, D., Harrington, K., Burnett, G., & Georgiou, O. (2019). Feel the noise: Mid-air ultrasound haptics as a novel human-vehicle interaction paradigm. Applied Ergonomics, 81, Article 102909. https://doi.org/10.1016/j.apergo.2019.102909

• Journal Article Type: Article
• Acceptance Date: Jul 20, 2019
• Online Publication Date: Jul 26, 2019
• Publication Date: 2019-11
• Deposit Date: Jul 22, 2019
• Publicly Available Date: Jul 27, 2020
• Journal: Applied Ergonomics
• Print ISSN: 0003-6870
• Electronic ISSN: 1872-9126
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 81
• Article Number: 102909
• DOI: https://doi.org/10.1016/j.apergo.2019.102909
• Keywords: Physical Therapy, Sports Therapy and Rehabilitation; Human Factors and Ergonomics; General Medicine
• Public URL: https://nottingham-repository.worktribe.com/output/2329631
• Publisher URL: https://www.sciencedirect.com/science/article/abs/pii/S0003687019301395
• Additional Information: This article is maintained by: Elsevier; Article Title: Feel the noise: Mid-air ultrasound haptics as a novel human-vehicle interaction paradigm; Journal Title: Applied Ergonomics; CrossRef DOI link to publisher maintained version: https://doi.org/10.1016/j.apergo.2019.102909; Content Type: article; Copyright: © 2019 Elsevier Ltd. All rights reserved.
• Contract Date: Jul 24, 2019