City Research Online

Exploring Deaf And Hard of Hearing Peoples' Perspectives On Tasks In Augmented Reality: Interacting With 3D Objects And Instructional Comprehension

Luna, S. M., Xu, J., Tigwell, G. W. , LaLone, N., Saker, M. ORCID: 0000-0002-7414-2840, Chamberlain, A., Schwartz, D. I. & Papangelis, K. (2025). Exploring Deaf And Hard of Hearing Peoples' Perspectives On Tasks In Augmented Reality: Interacting With 3D Objects And Instructional Comprehension. In: Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems. CHI 2025: CHI Conference on Human Factors in Computing Systems, 26 Apr - 1 May 2025, Yokohama, Japan. doi: 10.1145/3706598.3713678

Abstract

Tasks in augmented reality (AR), such as 3D interaction and instructional comprehension, are often designed for users with uniform sensory abilities. Such an approach, however, can overlook the more nuanced needs of Deaf and Hard of Hearing (DHH) users who might have reduced auditory perception. To better understand these challenges, our study utilized the single-player AR game Angry Birds AR as a probe to explore how 11 DHH participants and 15 hearing participants experienced AR interactions. Our findings highlight that DHH users prefer interaction based on context, effective haptic cues, audio cue substitutes, and clear instructional design. We, therefore, propose the following design recommendations to enhance the accessibility of AR for DHH users. This includes customizable UI options, modular feedback systems, and virtual avatars for sign language instructions.

Publication Type: Conference or Workshop Item (Paper)
Additional Information: Copyright © 2025 Copyright held by the owner/author(s). This work is licensed under a Creative Commons Attribution 4.0 International License.
Publisher Keywords: Deaf and Hard of Hearing; Augmented Reality; Accessibility; Accessible AR
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
R Medicine > R Medicine (General)
Departments: School of Policy & Global Affairs
School of Policy & Global Affairs > Sociology & Criminology
SWORD Depositor:
[thumbnail of 3706598.3713678.pdf]
Preview
Text - Published Version
Available under License Creative Commons Attribution.

Download (10MB) | Preview

Export

Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email

Downloads

Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login