Communication, Collaboration, and Coordination in a Co-located Shared Augmented Reality Game: Perspectives From Deaf and Hard of Hearing People

Luna, Sanzida Mojib; Xu, Jiangnan; Papangelis, Konstantinos; Tigwell, Garreth W.; Lalone, Nicolas; Saker, Michael; Chamberlain, Alan; Laato, Samuli; Dunham, John; Wang, Yihong

Abstract

Co-located collaborative shared augmented reality (CS-AR) environments have gained considerable research attention, mainly focusing on design, implementation, accuracy, and usability. Yet, a gap persists in our understanding regarding the accessibility and inclusivityof such environments for diverse user groups, such as deaf and Hard of Hearing (DHH) people. To investigate this domain, we used Urban Legends, a multiplayer game in a co-located CS-AR setting. We conducted a user study followed by one-on-one interviews with 17 DHH participants. Our fndings revealed the usage of multimodal communication (verbal and non-verbal) before and during the game, impacting the amount of collaboration among participants and how their coordination with AR components, their surroundings, and other participants improved throughout the rounds. We utilize our data to propose design enhancements, including onscreen visuals and speech-to-text transcription, centered on participant perspectives and our analysis.

Citation

Luna, S. M., Xu, J., Papangelis, K., Tigwell, G. W., Lalone, N., Saker, M., …Wang, Y. (2024). Communication, Collaboration, and Coordination in a Co-located Shared Augmented Reality Game: Perspectives From Deaf and Hard of Hearing People. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI ’24), May 11–16, 2024, Honolulu, HI, USA (1-14). https://doi.org/10.1145/3613904.3642953

• Presentation Conference Type: Edited Proceedings
• Conference Name: CHI Conference on Human Factors in Computing Systems (CHI ’24)
• Start Date: May 11, 2024
• End Date: May 16, 2024
• Acceptance Date: Mar 12, 2024
• Online Publication Date: May 11, 2024
• Publication Date: May 11, 2024
• Deposit Date: Mar 12, 2024
• Publicly Available Date: May 11, 2024
• Publisher: Association for Computing Machinery (ACM)
• Pages: 1-14
• Book Title: Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI ’24), May 11–16, 2024, Honolulu, HI, USA
• ISBN: 9798400703300
• DOI: https://doi.org/10.1145/3613904.3642953
• Keywords: Deaf, Hard of Hearing, HCI, Design, AR, Augmented Reality, Graphics, Computing, Research
• Public URL: https://nottingham-repository.worktribe.com/output/32458331
• Publisher URL: https://dl.acm.org/doi/10.1145/3613904.3642953
• Related Public URLs: https://chi2024.acm.org/
• Additional Information: Published: 2024-05-11