City Research Online

Towards Multimodal Data Analytics: Integrating Natural Language into Visual Analytics

Henkin, R. ORCID: 0000-0002-5511-5230 & Turkay, C. ORCID: 0000-0001-6788-251X (2018). Towards Multimodal Data Analytics: Integrating Natural Language into Visual Analytics. Paper presented at the Multimodal Interaction for Data Visualization Workshop at AVI 2018, 29 May 2018, Grosseto, Italy.


The continuous interaction between users and the system in visual analytics can be considered a dialogue. We propose the use of multiple two-way channels facilitated by a multimodal interface as a central aspect of interactive visualization design, in particular, the use of natural language with interactive visualization. We discuss key related concepts, potential benefits, challenges and opportunities that emerge as a research agenda for multimodal data analysis.

Publication Type: Conference or Workshop Item (Paper)
Additional Information: Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s). MultimodalVis 18 Workshop at AVI 2018, May 29, 2018, Grosseto, Italy. https://multimodalvis.github.ioc © 2018 Copyright is held by the owner/author(s).
Departments: School of Science & Technology > Computer Science
School of Science & Technology > Computer Science > giCentre
[thumbnail of Towards Multimodal Data Analytics.pdf]
Text - Published Version
Download (198kB) | Preview


Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email


Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login