A systematic review of artificial intelligence impact assessments

Stahl, Bernd Carsten; Antoniou, Josephina; Bhalla, Nitika; Brooks, Laurence; Jansen, Philip; Lindqvist, Blerta; Kirichenko, Alexey; Marchal, Samuel; Rodrigues, Rowena; Santiago, Nicole; Warso, Zuzanna; Wright, David

Abstract

Artificial intelligence (AI) is producing highly beneficial impacts in many domains, from transport to healthcare, from energy distribution to marketing, but it also raises concerns about undesirable ethical and social consequences. AI impact assessments (AI-IAs) are a way of identifying positive and negative impacts early on to safeguard AI’s benefits and avoid its downsides. This article describes the first systematic review of these AI-IAs. Working with a population of 181 documents, the authors identified 38 actual AI-IAs and subjected them to a rigorous qualitative analysis with regard to their purpose, scope, organisational context, expected issues, timeframe, process and methods, transparency and challenges. The review demonstrates some convergence between AI-IAs. It also shows that the field is not yet at the point of full agreement on content, structure and implementation. The article suggests that AI-IAs are best understood as means to stimulate reflection and discussion concerning the social and ethical consequences of AI ecosystems. Based on the analysis of existing AI-IAs, the authors describe a baseline process of implementing AI-IAs that can be implemented by AI developers and vendors and that can be used as a critical yardstick by regulators and external observers to evaluate organisations’ approaches to AI.

Citation

Stahl, B. C., Antoniou, J., Bhalla, N., Brooks, L., Jansen, P., Lindqvist, B., Kirichenko, A., Marchal, S., Rodrigues, R., Santiago, N., Warso, Z., & Wright, D. (2023). A systematic review of artificial intelligence impact assessments. Artificial Intelligence Review, 56(11), 12799 -12831. https://doi.org/10.1007/s10462-023-10420-8

• Journal Article Type: Article
• Acceptance Date: Feb 1, 2023
• Online Publication Date: Mar 24, 2023
• Publication Date: 2023-11
• Deposit Date: Apr 1, 2023
• Publicly Available Date: Apr 4, 2023
• Journal: Artificial Intelligence Review
• Print ISSN: 0269-2821
• Electronic ISSN: 1573-7462
• Publisher: Springer Verlag
• Peer Reviewed: Peer Reviewed
• Volume: 56
• Issue: 11
• Pages: 12799 -12831
• DOI: https://doi.org/10.1007/s10462-023-10420-8
• Keywords: AI · Impact assessment · Systematic review · AI governance
• Public URL: https://nottingham-repository.worktribe.com/output/19009698
• Publisher URL: https://link.springer.com/article/10.1007/s10462-023-10420-8