Exploring the Impact of Verbal-Imagery Cognitive Style on Web Search Behaviour and Mental Workload

Tang, Huimin; Benerradi, Johann; Maior, Horia A.; Pike, Matthew; Landowska, Aleksandra; Wilson, Max L.

Abstract

Cognitive style has been shown to influence users’ interaction with search interfaces. However, as a fundamental dimension of cognitive styles, the relationship between the Verbal-Imagery (VI) cognitive style dimension and search behaviour has not been studied thoroughly, and it is not clear whether VI cognitive style can be used to inform search user interface design. We present a study (N=29), investigating how search behaviour and mental workload (MWL) changes relate to VI cognitive styles by examining participants’ search behaviour across three increasingly complex tasks. MWL was subjectively rated by participants, and blood oxygenation changes in the prefrontal cortex were measured using functional near-infrared spectroscopy (fNIRS).

Our results revealed a significant difference between verbalisers and imagers in search behaviour. In particular, verbalisers preferred a Sporadic navigation style and adopted the Scanning strategy as they processed information, according to their viewing and bookmarking patterns, whereas imagers preferred the Structured navigation style and reading information in detail. The fNIRS data showed that verbalisers had significantly higher blood oxygenation in the prefrontal cortex when using the same search interface, suggesting a higher MWL than imagers. When based on task complexity bias, the search time significantly increased as task complexity increased, but there were no significant differences in search behaviours. Our study indicated that VI cognitive styles have a noticeable and stronger impact on users’ searching behaviour and their MWL when interacting with the same interface than task complexity, which can be considered further in future search behaviour studies and search user interface design.

• Conference Name: CHIIR '24: Proceedings of the 2024 ACM SIGIR Conference on Human Information Interaction and Retrieval
• Conference Location: Sheffield, UK
• Start Date: Mar 10, 2024
• End Date: Mar 14, 2024
• Acceptance Date: Jan 23, 2024
• Online Publication Date: Mar 10, 2024
• Publication Date: Mar 10, 2024
• Deposit Date: Mar 12, 2024
• Publicly Available Date: Mar 14, 2024
• Publisher: Association for Computing Machinery (ACM)
• Pages: 303–316
• DOI: https://doi.org/10.1145/3627508.3638313
• Public URL: https://nottingham-repository.worktribe.com/output/32180110
• Publisher URL: https://dl.acm.org/doi/10.1145/3627508.3638313
• Additional Information: Published: 2024-03-10