City Research Online

Social sensemaking with AI: Designing an open-ended AI experience with a blind child

Morrison, C., Cutrell, E., Grayson, M., Thieme, A., Taylor, A. ORCID: 0000-0001-6311-3967, Roumen, G., Longden, C., Tschiatschek, S., Marques, R. F. and Sellen, A. (2021). Social sensemaking with AI: Designing an open-ended AI experience with a blind child. Paper presented at the 2021 CHI Conference on Human Factors in Computing Systems, 8-13 May 2021, Online.

Abstract

AI technologies are often used to aid people in performing discrete tasks with well-defned goals (e.g., recognising faces in images). Emerging technologies that provide continuous, real-time information enable more open-ended AI experiences. In partnership with a blind child, we explore the challenges and opportunities of designing human-AI interaction for a system intended to support social sensemaking. Adopting a research-through-design perspective, we refect upon working with the uncertain capabilities of AI systems in the design of this experience. We contribute: (i) a concrete example of an open-ended AI system that enabled a blind child to extend his own capabilities; (ii) an illustration of the delta between imagined and actual use, highlighting how capabilities derive from the human-AI interaction and not the AI system alone; and (iii) a discussion of design choices to craft an ongoing human-AI interaction that addresses the challenge of uncertain outputs of AI systems.

Publication Type: Conference or Workshop Item (Paper)
Additional Information: © the authors | ACM 2021. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record is to be published in ACM Conference on ACM CHI Conference on Human Factors in Computing Systems (https://chi2021.acm.org/), DOI: https://doi.org/10.1145/3411764.3445290
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
R Medicine
Departments: School of Mathematics, Computer Science & Engineering > Computer Science
Date available in CRO: 06 Sep 2021 10:50
Date deposited: 6 September 2021
Date of first online publication: 6 May 2021
URI: https://openaccess.city.ac.uk/id/eprint/26708
[img]
Preview
Text - Accepted Version
Download (958kB) | Preview
Official URL: https://chi2021.acm.org/

Export

Downloads

Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login