Assessing the Validity of Low and Medium-Fidelity Driving Simulators for HMI Distraction Testing – A Subjective Approach

Merriman, Siobhan; Large, David; Pampel, Sanna; Burnett, Gary

Abstract

Simulators are commonly employed for conducting driving-related research due to their increased flexibility, safety and control compared to on-the-road studies [1]. However, concerns have been raised regarding the validity of the approach, that is, the extent to which the method reproduces behaviour that would be seen in the real world, particularly when conducting distraction testing [2]. The primary concern is that drivers may assume riskier driving practices or engage in activities during simulated driving that they would not consider undertaking on the road. Factors, such as the fidelity of the simulator (“the degree to which it replicates reality”) are also considered to influence the validity of the approach. Validation studies typically aim to determine whether a simulator holds relative validity (i.e. it produces the same behaviour and ordering of effects as would occur in the real world) or absolute validity (effects are identical). In the context of driver distraction testing, validation studies therefore employ a variety of objective measures, for example, visual behaviour (off-road glances, gaze focus/attention), driving performance and secondary task performance [3-6]. However, reported findings are mixed. For example, medium fidelity driving simulators have shown both relative and absolute validity for visual behaviour [3,6], although driving performance (in particular, lateral control and speed when undertaking secondary tasks) has shown much greater variability and inconsistency in the simulator [5,6]. It can therefore be difficult to generalise from results obtained in a driving simulator, and the “lack of genuine risk” is often cited for unexpected or inconsistent behaviour. However, a factor that is often overlooked in driving validation studies is that of face validity – the extent to which the method is subjectively viewed as covering the concept it purports to measure (i.e., do participants feel they are driving, and act accordingly). In this respect, using a real vehicle enclosure (as opposed to a desktop configuration) is considered important, as it can help to encourage a sense of presence.

Citation

Merriman, S., Large, D., Pampel, S., & Burnett, G. (2021, October). Assessing the Validity of Low and Medium-Fidelity Driving Simulators for HMI Distraction Testing – A Subjective Approach. Presented at 7th International Conference on Driver Distraction and Inattention (DDI2021), Lyon, France

• Presentation Conference Type: Conference Paper (published)
• Conference Name: 7th International Conference on Driver Distraction and Inattention (DDI2021)
• Start Date: Oct 18, 2021
• End Date: Oct 20, 2021
• Acceptance Date: Jul 15, 2020
• Publication Date: Oct 18, 2021
• Deposit Date: Feb 18, 2022
• Publicly Available Date: Feb 22, 2022
• Keywords: Distraction, risk perception, simulator validity
• Public URL: https://nottingham-repository.worktribe.com/output/7474110
• Related Public URLs: https://ddi2020.sciencesconf.org/