City Research Online

Towards Multimodal Data Analytics: Integrating Natural Language into Visual Analytics

Henkin, R. ORCID: 0000-0002-5511-5230 and Turkay, C. ORCID: 0000-0001-6788-251X (2018). Towards Multimodal Data Analytics: Integrating Natural Language into Visual Analytics. Paper presented at the Multimodal Interaction for Data Visualization Workshop at AVI 2018, 29 May 2018, Grosseto, Italy.


The continuous interaction between users and the system in visual analytics can be considered a dialogue. We propose the use of multiple two-way channels facilitated by a multimodal interface as a central aspect of interactive visualization design, in particular, the use of natural language with interactive visualization. We discuss key related concepts, potential benefits, challenges and opportunities that emerge as a research agenda for multimodal data analysis.

Publication Type: Conference or Workshop Item (Paper)
Additional Information: Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the owner/author(s). MultimodalVis 18 Workshop at AVI 2018, May 29, 2018, Grosseto, Italy. https://multimodalvis.github.ioc © 2018 Copyright is held by the owner/author(s).
Departments: School of Mathematics, Computer Science & Engineering > Computer Science
Date Deposited: 06 Sep 2018 10:16
Text - Published Version
Download (198kB) | Preview



Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login