A Pilot Study Evaluating a Virtual Reality-Based Nontechnical Skills Training Application for Urology Trainees: Usability, Acceptability, and Impact

Pears, Matthew; Rochester, Mark; Wadhwa, Karan; R Payne, Stephen; Konstantinidis, Stathis; Hanchanale, Vishwanath; Hamid Elmamoun, Mamoun; Shekhar Biyani, Chandra; Doherty, Ruth

Abstract

Objective
This study aimed to develop and evaluate a virtual reality (VR)-based nontechnical skills (NTS) training application for urology trainees and assess its effectiveness in improving their skills and confidence.

Design
A mixed-methods study was conducted to develop and evaluate a VR-based NTS training application for 32 urology trainees. The development process involved collaboration with 5 urology experts, 2 medical education specialists, and a human factors researcher. The study evaluated the application's usability, acceptability, and efficacy through 3 phases: scenario development with expert feedback integration, storyboarding and creation processes with facilitators and urology trainees, and a final evaluation by trainees.

Setting
The data were collected during a 4-day urology boot camp in October 2022.

Participants
Thirty-two urology trainees participated in the study and completed 2 VR scenarios designed to enhance their NTS skills

Results
The System Usability Scale (SUS) showed a moderate usability score of 66. The Training Evaluation Inventory (TEI) and additional feedback demonstrated positive effects on trainees' learning and confidence in their NTS abilities. Most participants found the application easy to use, and effective and they expressed interest in using similar VR applications for other aspects of surgical training.

Conclusions
VR-based NTS training applications show potential for enhancing urology trainees' nontechnical skills. The integration of expert feedback and immersive technology offers a promising, accessible, and cost-effective solution to the challenges of delivering NTS training. Future research should explore the long-term impact of VR-based NTS training on trainees' performance and patient outcomes and consider incorporating advanced AI technologies for personalized and dynamic learning experiences.

Citation

Pears, M., Rochester, M., Wadhwa, K., R Payne, S., Konstantinidis, S., Hanchanale, V., …Doherty, R. (2023). A Pilot Study Evaluating a Virtual Reality-Based Nontechnical Skills Training Application for Urology Trainees: Usability, Acceptability, and Impact. Journal of Surgical Education, 80(12), 1836-1842. https://doi.org/10.1016/j.jsurg.2023.08.012

• Journal Article Type: Article
• Acceptance Date: Aug 15, 2023
• Online Publication Date: Nov 24, 2023
• Publication Date: 2023-12
• Deposit Date: Oct 5, 2023
• Publicly Available Date: Nov 25, 2024
• Journal: Journal of Surgical Education
• Print ISSN: 1931-7204
• Electronic ISSN: 1878-7452
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 80
• Issue: 12
• Pages: 1836-1842
• DOI: https://doi.org/10.1016/j.jsurg.2023.08.012
• Public URL: https://nottingham-repository.worktribe.com/output/25392598
• Publisher URL: https://www.sciencedirect.com/science/article/abs/pii/S1931720423003100?via%3Dihub
• Additional Information: This article is maintained by: Elsevier; Article Title: A Pilot Study Evaluating a Virtual Reality-Based Nontechnical Skills Training Application for Urology Trainees: Usability, Acceptability, and Impact; Journal Title: Journal of Surgical Education; CrossRef DOI link to publisher maintained version: https://doi.org/10.1016/j.jsurg.2023.08.012; Content Type: article; Copyright: Crown Copyright © 2023 Published by Elsevier Inc. on behalf of Association of Program Directors in Surgery. All rights reserved.