City Research Online

LLM-Assisted Visual Analytics: Opportunities and Challenges

Hutchinson, M., Jianu, R. ORCID: 0000-0002-5834-2658, Slingsby, A. ORCID: 0000-0003-3941-553X & Madhyastha, P. ORCID: 0000-0002-4438-8161 (2024). LLM-Assisted Visual Analytics: Opportunities and Challenges. In: Computer Graphics & Visual Computing (CGVC) 2024. Computer Graphics & Visual Computing (CGVC) 2024, 12-13 Sep 2024, London, UK. doi: 10.2312/cgvc.20241237

Abstract

We explore the integration of large language models (LLMs) into visual analytics (VA) systems to transform their capabilities through intuitive natural language interactions. We survey current research directions in this emerging field, examining how LLMs are integrated into data management, language interaction, visualisation generation, and language generation processes. We highlight the new possibilities that LLMs bring to VA, especially how they can change VA processes beyond the usual use cases. We especially highlight building new visualisation-language models, allowing access of a breadth of domain knowledge, multimodal interaction, and opportunities with guidance. Finally, we carefully consider the prominent challenges of using current LLMs in VA tasks. Our discussions in this paper aim to guide future researchers working on LLM-assisted VA systems and help them navigate common obstacles when developing these systems.

Publication Type: Conference or Workshop Item (Paper)
Subjects: H Social Sciences > HN Social history and conditions. Social problems. Social reform
Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Departments: School of Science & Technology
School of Science & Technology > Computer Science
School of Science & Technology > Computer Science > giCentre
SWORD Depositor:
[thumbnail of cgvc20241237.pdf]
Preview
Text - Published Version
Available under License Creative Commons: Attribution International Public License 4.0.

Download (185kB) | Preview

Export

Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email

Downloads

Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login