Understanding Spatiotemporal-Aware Multimodal Conversational Search in the Outdoor Urban Space
Xu, J.
ORCID: 0000-0002-8932-8082, Seo, S.
ORCID: 0009-0003-6459-1196, Salminen, J.
ORCID: 0000-0003-3230-0561 , Saker, M.
ORCID: 0000-0002-7414-2840, Shin, J.
ORCID: 0000-0002-9974-8283, Chamberlain, A.
ORCID: 0000-0002-2122-8077, Papangelis, K.
ORCID: 0000-0001-5094-9837 & Kim, D. H.
ORCID: 0000-0002-8657-9986 (2026).
Understanding Spatiotemporal-Aware Multimodal Conversational Search in the Outdoor Urban Space.
In:
Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems.
CHI 2026: CHI Conference on Human Factors in Computing Systems, 13-17 Apr 2026, Barcelona, Spain.
doi: 10.1145/3772318.3790541
Abstract
Emerging multimodal conversational search (MCS) tools (e.g., Gemini Live) allow users to search for spatiotemporal information through natural language dialogues as they move through urban space. Despite the growing popularity of these tools, there is limited understanding of how people engage with this technology. To address this gap, we developed UrbanSearch, an MCS technology probe designed to capture the user’s current geolocation, time, and visual surroundings. A contextual inquiry (N=23) revealed that MCS tools provide two core values: requiring low effort in forming queries while offering highly relevant responses, and functioning as a central information gateway. As a promising technology, MCS supports environmental learning, in-situ decision making, and personalized navigation. Participants also revealed unmet needs for spatial reasoning and transparent integration of multi-source information, along with concerns related to peripheral awareness, social context, and personal space. Drawing from the findings, we discuss design implications for future MCS tools in urban spaces.
| Publication Type: | Conference or Workshop Item (Paper) |
|---|---|
| Publisher Keywords: | Urban Space, Conversational Search, Contextual Inquiry |
| Subjects: | G Geography. Anthropology. Recreation > GF Human ecology. Anthropogeography H Social Sciences > HM Sociology H Social Sciences > HN Social history and conditions. Social problems. Social reform Q Science > QA Mathematics > QA75 Electronic computers. Computer science |
| Departments: | School of Policy & Global Affairs School of Policy & Global Affairs > Department of Sociology & Criminology |
| SWORD Depositor: |
Available under License Creative Commons Attribution Non-commercial No Derivatives.
Download (5MB) | Preview
Export
Downloads
Downloads per month over past year
Metadata
Metadata