Temporal uncertainty during overshadowing: A temporal difference account

Jennings, D., Alonso, E., Mondragon, E. & Bonardi, C. (2010). Temporal uncertainty during overshadowing: A temporal difference account. In: Computational Neuroscience for Advancing Artificial Intelligence: Models, Methods and Applications. (pp. 46-55). IGI Global. ISBN 9781609600211

[img]
Preview
Text - Published Version
Download (868kB) | Preview

Abstract

Standard associative learning theories typically fail to conceptualise the temporal properties of a stimulus, and hence cannot easily make predictions about the effects such properties might have on the magnitude of conditioning phenomena. Despite this, in intuitive terms we might expect that the temporal properties of a stimulus that is paired with some outcome to be important. In particular, there is no previous research addressing the way that fixed or variable duration stimuli can affect overshadowing. In this chapter we report results which show that the degree of overshadowing depends on the distribution form - fixed or variable - of the overshadowing stimulus, and argue that conditioning is weaker under conditions of temporal uncertainty. These results are discussed in terms of models of conditioning and timing. We conclude that the temporal difference model, which has been extensively applied to the reinforcement learning problem in machine learning, accounts for the key findings of our study.

Item Type: Book Section
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
R Medicine > RC Internal medicine > RC0321 Neuroscience. Biological psychiatry. Neuropsychiatry
Divisions: School of Informatics > Department of Computing
URI: http://openaccess.city.ac.uk/id/eprint/5196

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics