Interacting meaningfully with machine learning systems: Three experiments

Stumpf, S., Rajaram, V., Li, L., Wong, W-K., Burnett, M., Dietterich, T. G., Sullivan, E. & Herlocker, J. (2009). Interacting meaningfully with machine learning systems: Three experiments. International Journal of Human Computer Studies, 67(8), pp. 639-662. doi: 10.1016/j.ijhcs.2009.03.004

[img]
Preview
Text - Accepted Version
Available under License : See the attached licence file.

Download (347kB) | Preview
[img]
Preview
Text (Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International Licence) - Other
Download (201kB) | Preview

Abstract

Although machine learning is becoming commonly used in today's software, there has been little research into how end users might interact with machine learning systems, beyond communicating simple “right/wrong” judgments. If the users themselves could work hand-in-hand with machine learning systems, the users’ understanding and trust of the system could improve and the accuracy of learning systems could be improved as well. We conducted three experiments to understand the potential for rich interactions between users and machine learning systems. The first experiment was a think-aloud study that investigated users’ willingness to interact with machine learning reasoning, and what kinds of feedback users might give to machine learning systems. We then investigated the viability of introducing such feedback into machine learning systems, specifically, how to incorporate some of these types of user feedback into machine learning systems, and what their impact was on the accuracy of the system. Taken together, the results of our experiments show that supporting rich interactions between users and machine learning systems is feasible for both user and machine. This shows the potential of rich human–computer collaboration via on-the-spot interactions as a promising direction for machine learning systems and users to collaboratively share intelligence.

Item Type: Article
Additional Information: © 2009, Elsevier. Licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/
Uncontrolled Keywords: Intelligent user interfaces; Rich feedback; Explanations; Machine learning
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions: School of Informatics > Centre for Human Computer Interaction Design
URI: http://openaccess.city.ac.uk/id/eprint/12417

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics