Skip to main content

Research Repository

Advanced Search

Communication, Collaboration, and Coordination in a Co-located Shared Augmented Reality Game: Perspectives From Deaf and Hard of Hearing People (2024)
Conference Proceeding
Luna, S. M., Xu, J., Papangelis, K., Tigwell, G. W., LaLone, N., Saker, M., …Wang, Y. (2024). Communication, Collaboration, and Coordination in a Co-located Shared Augmented Reality Game: Perspectives From Deaf and Hard of Hearing People. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI ’24), May 11–16, 2024, Honolulu, HI, USA (1-14). https://doi.org/10.1145/3613904.3642953

Co-located collaborative shared augmented reality (CS-AR) environments have gained considerable research attention, mainly focusing on design, implementation, accuracy, and usability. Yet, a gap persists in our understanding regarding the accessibili... Read More about Communication, Collaboration, and Coordination in a Co-located Shared Augmented Reality Game: Perspectives From Deaf and Hard of Hearing People.

FUTURE MACHINE: Making Myths & Designing Technology for a Responsible Future: Making Myths and Entanglement: Community engagement at the edge of participatory design and user experience (2023)
Conference Proceeding
Jacobs, R., Spence, J., Abbott, F., Chamberlain, A., Heim, W., Yemaoua Dayo, A., …King, J. (2023). FUTURE MACHINE: Making Myths & Designing Technology for a Responsible Future: Making Myths and Entanglement: Community engagement at the edge of participatory design and user experience. . https://doi.org/10.1145/3616961.3616979

This paper explores the unique methods and strategies employed by a team of artists, in collaboration with engineers, programmers, a climate scientist, researchers and members of the public, who have come together to create the Future Machine, with t... Read More about FUTURE MACHINE: Making Myths & Designing Technology for a Responsible Future: Making Myths and Entanglement: Community engagement at the edge of participatory design and user experience.

LABERT: A Combination of Local Aggregation and Self-Supervised Speech Representation Learning for Detecting Informative Hidden Units in Low-Resource ASR Systems (2023)
Conference Proceeding
Fatehi, K., & Kucukyilmaz, A. (2023). LABERT: A Combination of Local Aggregation and Self-Supervised Speech Representation Learning for Detecting Informative Hidden Units in Low-Resource ASR Systems. In Interspeech 2023

With advances in deep learning methodologies, Automatic Speech Recognition (ASR) systems have seen impressive results. However, ASR in Low-Resource Environments (LREs) are challenged by a lack of training data for the specific target domain. We propo... Read More about LABERT: A Combination of Local Aggregation and Self-Supervised Speech Representation Learning for Detecting Informative Hidden Units in Low-Resource ASR Systems.

Responsible Research and Innovation (RRI) Prompts and Practice Cards: a Tool to Support Responsible Practice (2023)
Conference Proceeding
Portillo, V., Greenhalgh, C., Craigon, P. J., & Ten Holter, C. (2023). Responsible Research and Innovation (RRI) Prompts and Practice Cards: a Tool to Support Responsible Practice. In TAS '23: Proceedings of the First International Symposium on Trustworthy Autonomous Systems. https://doi.org/10.1145/3597512.3599721

Researchers often find it hard to know where, when and how to start when applying Responsible Innovation approaches to their own research projects and proposals. Based on experience supporting a range of researchers and projects, we have developed a... Read More about Responsible Research and Innovation (RRI) Prompts and Practice Cards: a Tool to Support Responsible Practice.

Five Provocations for a More Creative TAS (2023)
Conference Proceeding
Benford, S., Hazzard, A., Vear, C., Webb, H., Chamberlain, A., Greenhalgh, C., …Marshall, J. (2023). Five Provocations for a More Creative TAS. In TAS ‘23: Proceedings of The First International Symposium on Trustworthy Autonomous Systems 11-12 July 2023 Edinburgh, UK. https://doi.org/10.1145/3597512.3599709

Conventional wisdom has it that trustworthy autonomous systems (AS) should be explainable, dependable, controllable and safe tools for humans to use. Reflecting on a portfolio of artistic applications of TAS leads us adopt an alternative stance and t... Read More about Five Provocations for a More Creative TAS.

TAS for Cats: An Artist-led Exploration of Trustworthy Autonomous Systems for Companion Animals (2023)
Conference Proceeding
Schneiders, E., Chamberlain, A., Fischer, J. E., Benford, S., Castle-Green, S., Ngo, V., …Mills, D. (2023). TAS for Cats: An Artist-led Exploration of Trustworthy Autonomous Systems for Companion Animals. In TAS ‘23: Proceedings of The First International Symposium on Trustworthy Autonomous Systems 11-12 July 2023 Edinburgh, UK. https://doi.org/10.1145/3597512.3597517

Cat Royale is an artist-led exploration of trustworthy autonomous systems (TAS) created by the TAS Hub's creative ambassadors Blast Theory. A small community of cats inhabits a purpose built 'cat utopia' at the centre of which a robot arm tries to en... Read More about TAS for Cats: An Artist-led Exploration of Trustworthy Autonomous Systems for Companion Animals.

A Practical Taxonomy of TAS-related Usecase Scenarios (2023)
Conference Proceeding
Masters, P., Young, V., Chamberlain, A., Weerawardhana, S., McKenna, P. E., Lu, Y., …Moreau, L. (2023). A Practical Taxonomy of TAS-related Usecase Scenarios. In TAS '23: Proceedings of the First International Symposium on Trustworthy Autonomous Systems (1-6). https://doi.org/10.1145/3597512.3597523

This paper proposes a taxonomy of experimental usecase scenarios to facilitate research into trustworthy autonomous systems (TAS). Unable to identify an open-access repository of usecases to support our research, the project team embarked on developm... Read More about A Practical Taxonomy of TAS-related Usecase Scenarios.

Explainable AI for the Arts: XAIxArts (2023)
Conference Proceeding
Bryan-Kinns, N., Ford, C., Chamberlain, A., Benford, S. D., Kennedy, H., Li, Z., …Rezwana, J. (2023). Explainable AI for the Arts: XAIxArts. In C&C '23: Proceedings of the 15th Conference on Creativity and Cognition. https://doi.org/10.1145/3591196.3593517

This first workshop on explainable AI for the Arts (XAIxArts) brings together a community of researchers and creative practitioners in Human-Computer Interaction (HCI), Interaction Design, AI, explainable AI (XAI), and Digital Arts to explore the rol... Read More about Explainable AI for the Arts: XAIxArts.

Socio-Technical Trust For Multi-Modal Hearing Assistive Technology (2023)
Conference Proceeding
Williams, J., Azim, T., Piskopani, A. M., Chamberlain, A., & Zhang, S. (2023). Socio-Technical Trust For Multi-Modal Hearing Assistive Technology. In IEEE ICASSPW 2023 Workshop Proceedings. https://doi.org/10.1109/ICASSPW59220.2023.10193586

The landscape of opportunity is rapidly changing for audio-visual (AV) hearing assistive technology. While hearing assistive devices, such as hearing aids, have traditionally been developed for populations of deaf and hard of hearing (DHH) communitie... Read More about Socio-Technical Trust For Multi-Modal Hearing Assistive Technology.

Ciao AI: the Italian adaptation and validation of the Chatbot Usability Scale (2023)
Journal Article
Borsci, S., Prati, E., Malizia, A., Schmettow, M., Chamberlain, A., & Federici, S. (2023). Ciao AI: the Italian adaptation and validation of the Chatbot Usability Scale. Personal and Ubiquitous Computing, https://doi.org/10.1007/s00779-023-01731-2

Chatbot-based tools are becoming pervasive in multiple domains from commercial websites to rehabilitation applications. Only recently, an eleven-item satisfaction inventory was developed (the ChatBot Usability Scale, BUS-11) to help designers in the... Read More about Ciao AI: the Italian adaptation and validation of the Chatbot Usability Scale.

GPT4 : The Ultimate Brain (2022)
Working Paper
Adesso, G. GPT4 : The Ultimate Brain

We introduce a powerful general probabilistic theory, GPT4, that extends classical and quantum theories to include higher-dimensional probabilistic models. GPT4 results from the four-fold integration of GPT in physics (Generalized Probabilistic T... Read More about GPT4 : The Ultimate Brain.

Designing for Trust: Autonomous Animal-Centric Robotic & AI Systems (2022)
Conference Proceeding
Chamberlain, A., Benford, S., Fischer, J., Barnard, P., Greenhalgh, C., Row Farr, J., …Adams, M. (2022). Designing for Trust: Autonomous Animal-Centric Robotic & AI Systems. In ACI '22: Proceedings of the Ninth International Conference on Animal-Computer Interaction. https://doi.org/10.1145/3565995.3566046

From cat feeders and cat flaps to robot toys, humans are deploying increasingly autonomous systems to look after their pets. In parallel, industry is developing the next generation of autonomous systems to look after humans in the home – most notably... Read More about Designing for Trust: Autonomous Animal-Centric Robotic & AI Systems.

ScoutWav: Two-Step Fine-Tuning on Self-Supervised Automatic Speech Recognition for Low-Resource Environments (2022)
Conference Proceeding
Fatehi, K., Torres, M. T., & Kucukyilmaz, A. (2022). ScoutWav: Two-Step Fine-Tuning on Self-Supervised Automatic Speech Recognition for Low-Resource Environments. In Proceedings of Interspeech 2022 (3523-3527). https://doi.org/10.21437/Interspeech.2022-10270

Recent improvements in Automatic Speech Recognition (ASR) systems obtain extraordinary results. However, there are specific domains where training data can be either limited or not representative enough, which are known as Low-Resource Environments (... Read More about ScoutWav: Two-Step Fine-Tuning on Self-Supervised Automatic Speech Recognition for Low-Resource Environments.

A confirmatory factorial analysis of the Chatbot Usability Scale: a multilanguage validation (2022)
Journal Article
Borsci, S., Schmettow, M., Malizia, A., Chamberlain, A., & van der Velde, F. (2023). A confirmatory factorial analysis of the Chatbot Usability Scale: a multilanguage validation. Personal and Ubiquitous Computing, 27, 317–330. https://doi.org/10.1007/s00779-022-01690-0

The Bot Usability Scale (BUS) is a standardised tool to assess and compare the satisfaction of users after interacting with chatbots to support the development of usable conversational systems. The English version of the 15-item BUS scale (BUS-15) wa... Read More about A confirmatory factorial analysis of the Chatbot Usability Scale: a multilanguage validation.

Push-to-See: Learning Non-Prehensile Manipulation to Enhance Instance Segmentation via Deep Q-Learning (2022)
Conference Proceeding
Serhan, B., Pandya, H., Kucukyilmaz, A., & Neumann, G. (2022). Push-to-See: Learning Non-Prehensile Manipulation to Enhance Instance Segmentation via Deep Q-Learning. In IEEE International Conference on Robotics and Automation (ICRA 2022) (1513-1519). https://doi.org/10.1109/ICRA46639.2022.9811645

Efficient robotic manipulation of objects for sorting and searching often rely upon how well the objects are perceived and the available grasp poses. The challenge arises when the objects are irregular, have similar visual features (e.g., textureless... Read More about Push-to-See: Learning Non-Prehensile Manipulation to Enhance Instance Segmentation via Deep Q-Learning.

Metaverse: The Vision for the Future (2022)
Conference Proceeding
Xu, J., Papangelis, K., Dunham, J., Goncalves, J., LaLone, N. J., Chamberlain, A., …Schwartz, D. I. (2022). Metaverse: The Vision for the Future. In CHI EA '22: Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (1-3). https://doi.org/10.1145/3491101.3516399

In recent years, the notion of the Metaverse has become the focus of a growing body of work in the industry. However, there is no consensus on the conceptualization in academia. To date, much of this attention has revolved around technological challe... Read More about Metaverse: The Vision for the Future.

ALTCAI: Enabling the Use of Embodied Conversational Agents to Deliver Informal Health Advice during Wizard of Oz Studies (2021)
Conference Proceeding
Galvez Trigo, M. J., Porcheron, M., Egede, J., Fischer, J. E., Hazzard, A., Greenhalgh, C., …Valstar, M. (2021). ALTCAI: Enabling the Use of Embodied Conversational Agents to Deliver Informal Health Advice during Wizard of Oz Studies. In Proceedings of CUI 2021 : Conversational User Interfaces. https://doi.org/10.1145/3469595.3469621

We present ALTCAI, a Wizard of Oz Embodied Conversational Agent that has been developed to explore the use of interactive agents as an effective and engaging tool for delivering health and well-being advice to expectant and nursing mothers in Nigeria... Read More about ALTCAI: Enabling the Use of Embodied Conversational Agents to Deliver Informal Health Advice during Wizard of Oz Studies.

Teachers’ Perspectives on the Adoption of an Adaptive Learning System Based on Multimodal Affect Recognition for Students with Learning Disabilities and Autism (2021)
Conference Proceeding
Standen, P. J., Brown, D. J., Kwiatkowska, G. M., Belmonte, M. K., Galvez Trigo, M. J., Boulton, H., …Traversi, M. (2021). Teachers’ Perspectives on the Adoption of an Adaptive Learning System Based on Multimodal Affect Recognition for Students with Learning Disabilities and Autism. In R. A. Sottilare, & J. Schwarz (Eds.), Adaptive Instructional Systems. Design and Evaluation : Third International Conference, AIS 2021, Held as Part of the 23rd HCI International Conference, HCII 2021, Virtual Event, July 24–29, 2021, Proceedings, Part I. https://doi.org/10.1007/978-3-030-77857-6

Adoption of e-learning for those with special needs lags that for mainstream learners. Not much is known about barriers and facilitators that drive this disparity. The present study used focus groups and interviews to collect the views of 21 teachers... Read More about Teachers’ Perspectives on the Adoption of an Adaptive Learning System Based on Multimodal Affect Recognition for Students with Learning Disabilities and Autism.

Improving Uncertainty Estimation With Semi-supervised Deep Learning for COVID-19 Detection Using Chest X-ray Images (2021)
Journal Article
Calderon-Ramirez, S., Yang, S., Moemeni, A., Colreavy-Donnelly, S., Elizondo, D. A., Oala, L., …Molina-Cabello, M. A. (2021). Improving Uncertainty Estimation With Semi-supervised Deep Learning for COVID-19 Detection Using Chest X-ray Images. IEEE Access, 9, 85442 - 85454. https://doi.org/10.1109/ACCESS.2021.3085418

In this work we implement a COVID-19 infection detection system based on chest Xray images with uncertainty estimation. Uncertainty estimation is vital for safe usage of computer aided diagnosis tools in medical applications. Model estimations with h... Read More about Improving Uncertainty Estimation With Semi-supervised Deep Learning for COVID-19 Detection Using Chest X-ray Images.

Intelligent control of exoskeletons through a novel learning-from-demonstration method (2020)
Presentation / Conference
Ugur, E., Samur, E., Ugurlu, B., Erol Barkana, D., Kucukyilmaz, A., & Bebek, O. (2020, September). Intelligent control of exoskeletons through a novel learning-from-demonstration method. Poster presented at Cybathlon Symposium 2020, Zurich, Switzerland

We present a novel concept that enables the intelligent and adaptive control of exoskeletons through exploiting our state-of-the-art learning from demonstration (LfD) method, namely Conditional Neural Movement Primitives (CNMPs) [1], on our integrate... Read More about Intelligent control of exoskeletons through a novel learning-from-demonstration method.