User study on 3D multitouch interaction (3DMi) and gaze on surface computing

Ch�ng, Eugene; Cooke, Neil

Abstract

On a multitouch table, user’s interactions with 3D virtual representations of real objects should be influenced by task and their perceived physical characteristics. This article explores the development and user study of an interactive 3D application that allows users to explore virtual heritage objects on a surface device. To-date, most multitouch has focused on 2D or 2.5D systems. A user-study is reported where we analyse their multimodal behaviour – specifically how they interact on a surface device with objects that have similar properties to physical versions and the users’ associated gaze patterns with touch. The study reveals that gaze characteristics are different according to their interaction intention in terms of position and duration of visual attention. We discovered that virtual objects afford the perception of haptic attributes ascribed to their equivalent physical objects, and that differences in the summary statistics of gaze showed consistent characteristics between people and differences between natural and task based activities. An awareness of user behaviours using natural gestures can inform the design of interactive 3D applications which complements the user’s model of past experience with physical objects and with GUI interaction.

Citation

Ch’ng, E., & Cooke, N. (in press). User study on 3D multitouch interaction (3DMi) and gaze on surface computing. Lecture Notes in Artificial Intelligence, 9187, https://doi.org/10.1007/978-3-319-20898-5_41

• Journal Article Type: Article
• Acceptance Date: Jan 1, 2015
• Online Publication Date: Jul 1, 2015
• Deposit Date: Jan 4, 2018
• Publicly Available Date: Jan 4, 2018
• Journal: Lecture Notes in Artificial Intelligence
• Print ISSN: 0302-9743
• Electronic ISSN: 0302-9743
• Publisher: Springer Verlag
• Peer Reviewed: Peer Reviewed
• Volume: 9187
• Book Title: Design, User Experience, and Usability: Users and Interactions
• DOI: https://doi.org/10.1007/978-3-319-20898-5_41
• Keywords: Interactive 3D, multitouch, surface computing, digital heritage, gaze tracking
• Public URL: https://nottingham-repository.worktribe.com/output/752946
• Publisher URL: https://link.springer.com/chapter/10.1007%2F978-3-319-20898-5_41
• Additional Information: This is a post-peer-review, pre-copyedit version of an article published in Lecture Notes in Artificial Intelligence. The final authenticated version is available online at: http://dx.doi.org/10.1007/978-3-319-20898-5_41.
• Contract Date: Jan 4, 2018