Legal Provocations for HCI in the Design and Development of Trustworthy Autonomous Systems

Urquhart, Lachlan D.; McGarry, Glenn; Crabtree, Andy

Abstract

We propose a series of legal provocations emerging from the proposed European Union Artificial Intelligence Act 2021 (AIA) and explore how they open up new possibilities for HCI in the design and development of trustworthy autonomous systems. The AIA continues the by design' trend seen in recent EU regulation of emerging technologies. The AIA targets AI developments that pose risks to society and citizens' fundamental rights, introducing mandatory design and development requirements for high-risk AI systems (HRAIS). These requirements regulate different stages of the AI development cycle including ensuring data quality and governance strategies, mandating testing of systems, ensuring appropriate risk management, designing for human oversight, and creating technical documentation. These requirements open up new opportunities for HCI that reach beyond established concerns with the ethics and explainability of AI and situate AI development in human-centered processes and methods of design to enable compliance with regulation and foster societal trust in AI.

Citation

Urquhart, L. D., McGarry, G., & Crabtree, A. (2022, October). Legal Provocations for HCI in the Design and Development of Trustworthy Autonomous Systems. Presented at NordiCHI '22: Nordic Human-Computer Interaction Conference, Aarhus, Denmark

• Presentation Conference Type: Edited Proceedings
• Conference Name: NordiCHI '22: Nordic Human-Computer Interaction Conference
• Start Date: Oct 8, 2022
• End Date: Oct 12, 2022
• Acceptance Date: Jul 1, 2022
• Online Publication Date: Oct 8, 2022
• Publication Date: Oct 8, 2022
• Deposit Date: Mar 19, 2025
• Peer Reviewed: Peer Reviewed
• Pages: 1-12
• Book Title: NordiCHI '22: Nordic Human-Computer Interaction Conference
• ISBN: 9781450396998
• DOI: https://doi.org/10.1145/3546155.3546690
• Public URL: https://nottingham-repository.worktribe.com/output/12888487
• Publisher URL: https://dl.acm.org/doi/10.1145/3546155.3546690
• Additional Information: NordiCHI '22: Nordic Human-Computer Interaction Conference; Article No.: 75, Pages 1 - 12
• Other Repo URL: https://www.research.ed.ac.uk/en/publications/legal-provocations-for-hci-in-the-design-and-development-of-trust