Ultrahapticons: “Haptifying” Drivers’ Mental Models to Transform Automotive Mid-Air Haptic Gesture Infotainment Interfaces

Brown, Eddie; Large, David R.; Limerick, Hannah; Burnett, Gary

Abstract

In-vehicle gesture interfaces show potential to reduce visual demand and improve task performance when supported with mid-air, ultrasound-haptic feedback. However, comparative studies have tended to select gestures and haptic sensations based either on experimental convenience or to conform with existing interfaces, and thus may have fallen short on realising their full potential. Aiming to design and validate an exemplar set of ultrasonic, mid-air haptic icons (“ultrahapticons”), a participatory design exercise was conducted, whereby seventeen participants were presented with seven in-vehicle infotainment tasks. Participants were asked to describe their mental models for each, and then sketch these visual, tactual and auditory associations. ‘Haptifiable’ elements were extracted, and these were analysed using semiotics principles, resulting in thirty ultrahapticon concepts. These were subsequently evaluated and further refined in a workshop involving user experience and haptics experts. The final seventeen concepts will be validated in a salience recognition and perspicuity study.

Citation

Brown, E., Large, D. R., Limerick, H., & Burnett, G. (2020, September). Ultrahapticons: “Haptifying” Drivers’ Mental Models to Transform Automotive Mid-Air Haptic Gesture Infotainment Interfaces. Presented at 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '20), online

• Presentation Conference Type: Edited Proceedings
• Conference Name: 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '20)
• Start Date: Sep 21, 2020
• End Date: Sep 22, 2020
• Acceptance Date: Jul 9, 2020
• Online Publication Date: Sep 21, 2020
• Publication Date: Sep 21, 2020
• Deposit Date: Jul 26, 2022
• Publicly Available Date: Jul 26, 2022
• Publisher: Association for Computing Machinery (ACM)
• Peer Reviewed: Peer Reviewed
• Pages: 54-57
• Book Title: AutomotiveUI '20: 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
• ISBN: 9781450380669
• DOI: https://doi.org/10.1145/3409251.3411722
• Public URL: https://nottingham-repository.worktribe.com/output/9402086
• Publisher URL: https://dl.acm.org/doi/10.1145/3409251.3411722