Exploring Deaf And Hard of Hearing Peoples' Perspectives On Tasks In Augmented Reality: Interacting With 3D Objects And Instructional Comprehension
Luna, S. M., Xu, J., Tigwell, G. W. , LaLone, N., Saker, M. ORCID: 0000-0002-7414-2840, Chamberlain, A., Schwartz, D. I. & Papangelis, K. (2025).
Exploring Deaf And Hard of Hearing Peoples' Perspectives On Tasks In Augmented Reality: Interacting With 3D Objects And Instructional Comprehension.
In:
Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems.
CHI 2025: CHI Conference on Human Factors in Computing Systems, 26 Apr - 1 May 2025, Yokohama, Japan.
doi: 10.1145/3706598.3713678
Abstract
Tasks in augmented reality (AR), such as 3D interaction and instructional comprehension, are often designed for users with uniform sensory abilities. Such an approach, however, can overlook the more nuanced needs of Deaf and Hard of Hearing (DHH) users who might have reduced auditory perception. To better understand these challenges, our study utilized the single-player AR game Angry Birds AR as a probe to explore how 11 DHH participants and 15 hearing participants experienced AR interactions. Our findings highlight that DHH users prefer interaction based on context, effective haptic cues, audio cue substitutes, and clear instructional design. We, therefore, propose the following design recommendations to enhance the accessibility of AR for DHH users. This includes customizable UI options, modular feedback systems, and virtual avatars for sign language instructions.
Publication Type: | Conference or Workshop Item (Paper) |
---|---|
Additional Information: | Copyright © 2025 Copyright held by the owner/author(s). This work is licensed under a Creative Commons Attribution 4.0 International License. |
Publisher Keywords: | Deaf and Hard of Hearing; Augmented Reality; Accessibility; Accessible AR |
Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science R Medicine > R Medicine (General) |
Departments: | School of Policy & Global Affairs School of Policy & Global Affairs > Sociology & Criminology |
SWORD Depositor: |
Available under License Creative Commons Attribution.
Download (10MB) | Preview
Export
Downloads
Downloads per month over past year