A Systemic Functional Linguistics Discourse Analysis of Learner-Centered, Generative AI Feedback in Higher Education

Zapata, Gabriela C.; Tzirides, Anastasia Olga (Olnancy); Cope, Bill; You, Yu-Ling; Kalantzis, Mary; Searsmith, Duane

Abstract

The rapid development of Generative AI (GenAI) has opened new possibilities for its use in higher education, particularly in assessment and formative feedback. This study investigates the pedagogical effectiveness of GenAI-generated feedback using Systemic Functional Linguistics and Appraisal Theory to analyze the language used by GenAI reviewers. We compared two sets of GenAI-generated reviews on student writing from a graduate program in an American university. The first set came from a platform connected to OpenAI’s GPT-3, while the second used GPT-4, customized with a 35-million-word disciplinary corpus. The second version aimed to align more closely with the program’s academic context and provide more relevant, theoretically grounded feedback to the students enrolled in it. Through discourse analysis, we identified linguistic features that made the calibrated AI reviewer more pedagogically effective. Our findings highlight how tailoring GenAI systems to disciplinary language and feedback frameworks can improve the quality of support offered to university students. Based on our results, we also discuss pedagogical implications and offer recommendations for further research.

Citation

Zapata, G. C., Tzirides, A. O. (., Cope, B., You, Y.-L., Kalantzis, M., & Searsmith, D. (2025). A Systemic Functional Linguistics Discourse Analysis of Learner-Centered, Generative AI Feedback in Higher Education

• Working Paper Type: Preprint
• Publication Date: Jul 24, 2025
• Deposit Date: Jul 28, 2025
• Publicly Available Date: Jul 28, 2025
• DOI: https://doi.org/10.35542/osf.io/nuhq2_v1
• Public URL: https://nottingham-repository.worktribe.com/output/52157281
• Publisher URL: https://osf.io/preprints/edarxiv/nuhq2_v1