City Research Online

The Flow of Trust: A Visualization Framework to Externalize, Explore, and Explain Trust in ML Applications

Elzen, S., Andrienko, G. ORCID: 0000-0002-8574-6295, Andrienko, N. ORCID: 0000-0002-8574-6295 , Fisher, B., Martins, R., Peltonen, J., Telea, A., Verleysen, M. & Rhyne, T-M. (2023). The Flow of Trust: A Visualization Framework to Externalize, Explore, and Explain Trust in ML Applications. IEEE Computer Graphics and Applications, 43(2), pp. 78-88. doi: 10.1109/mcg.2023.3237286


We present a conceptual framework for the development of visual interactive techniques to formalize and externalize trust in machine learning (ML) workflows. Currently, trust in ML applications is an implicit process that takes place in the user's mind. As such, there is no method of feedback or communication of trust that can be acted upon. Our framework will be instrumental in developing interactive visualization approaches that will help users to efficiently and effectively build and communicate trust in ways that fit each of the ML process stages. We formulate several research questions and directions that include: 1) a typology/taxonomy of trust objects, trust issues, and possible reasons for (mis)trust; 2) formalisms to represent trust in machine-readable form; 3) means by which users can express their state of trust by interacting with a computer system (e.g., text, drawing, marking); 4) ways in which a system can facilitate users' expression and communication of the state of trust; and 5) creation of visual interactive techniques for representation and exploration of trust over all stages of an ML pipeline.

Publication Type: Article
Additional Information: © 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Departments: School of Science & Technology > Computer Science > giCentre
SWORD Depositor:
[thumbnail of The_flow_of_trust-Revision_Clean.pdf]
Text - Accepted Version
Download (1MB) | Preview


Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email


Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login