Investigating effects of emoji on neutral narrative text: Evidence from eye movements and perceived emotional valence

Robus, Christopher M.; Hand, Christopher J.; Filik, Ruth; Pitchford, Melanie

Abstract

Digital images of faces such as emoji in virtual communication have become increasingly popular, but current research findings are inconsistent regarding their emotional effects on perceptions of text. Similarly, emoji effects on reading behaviours are largely unknown and require further examination. The present study (N = 41) investigated how the position and emotional valence of emoji in neutral narrative sentences influenced eye movements during reading and perceptions of sentence valence. Participants read neutral narrative sentences containing smiling or frowning emoji in sentence-initial or sentence-final positions and rated the perceived emotional valence of the sentence. Results from linear mixed-effects models demonstrated significantly longer fixations on sentence-final emoji and longer sentence reading times when emoji were in sentence-final positions. These findings are comparable to sentence ‘wrap-up’ effects witnessed in the processing of lexical units during sentence reading, providing new evidence towards the way readers integrate emoji into contextual processing. However, no impact of emoji valence or position on first-pass target word processing or sentence-valence ratings were found. This would refute previous suggestions that digital faces influence text valence, raising questions about reader preference for emoji or sentence sentiment, the influence of sentence formatting, and delivery/display mechanism on these effects.

Citation

Robus, C. M., Hand, C. J., Filik, R., & Pitchford, M. (2020). Investigating effects of emoji on neutral narrative text: Evidence from eye movements and perceived emotional valence. Computers in Human Behavior, 109, Article 106361. https://doi.org/10.1016/j.chb.2020.106361

• Journal Article Type: Article
• Acceptance Date: Mar 29, 2020
• Online Publication Date: Apr 3, 2020
• Publication Date: 2020-08
• Deposit Date: Apr 2, 2020
• Publicly Available Date: Apr 4, 2021
• Journal: Computers in Human Behavior
• Print ISSN: 0747-5632
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 109
• Article Number: 106361
• DOI: https://doi.org/10.1016/j.chb.2020.106361
• Keywords: Human-Computer Interaction; Arts and Humanities (miscellaneous); General Psychology
• Public URL: https://nottingham-repository.worktribe.com/output/4242648
• Publisher URL: https://www.sciencedirect.com/science/article/pii/S074756322030114X