City Research Online

Modelling Emotion Based Reward Valuation with Computational Reinforcement Learning

Child, C. H. T. ORCID: 0000-0001-5425-2308, Koluman, C. and Weyde, T. ORCID: 0000-0001-8028-9905 (2019). Modelling Emotion Based Reward Valuation with Computational Reinforcement Learning. Paper presented at the Cogsci 2019, 24-27 Jul 2019, Montreal, Canada.

Abstract

We show that computational reinforcement learning can model human decision making in the Iowa Gambling Task (IGT). The IGT is a card game, which tests decision making under uncertainty. In our experiments, we found that modulating learning rate decay in Q-learning, enables the approximation of both the behaviour of normal subjects and those who are emotionally impaired by ventromedial prefrontal lesions. Outcomes observed in impaired subjects are modeled by high learning rate decay, while low learning rate decay replicates healthy subjects under otherwise identical conditions. The ventromedial prefrontal cortex has been associated with emotion based reward valuation, and, the value function in reinforcement learning provides an analogous assessment mechanism. Thus reinforcement learning can provide a good model for the role of emotional reward as a modulator of the learning rate.

Publication Type: Conference or Workshop Item (Paper)
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Departments: School of Mathematics, Computer Science & Engineering > Computer Science
URI: https://openaccess.city.ac.uk/id/eprint/22863
[img]
Preview
Text - Accepted Version
Download (1MB) | Preview

Export

Downloads

Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login