City Research Online

Temporal uncertainty during overshadowing: A temporal difference account

Jennings, D., Alonso, E., Mondragon, E. ORCID: 0000-0003-4180-1261 & Bonardi, C. (2010). Temporal uncertainty during overshadowing: A temporal difference account. In: Computational Neuroscience for Advancing Artificial Intelligence: Models, Methods and Applications. (pp. 46-55). IGI Global. doi: 10.4018/978-1-60960-021-1.ch003


Standard associative learning theories typically fail to conceptualise the temporal properties of a stimulus, and hence cannot easily make predictions about the effects such properties might have on the magnitude of conditioning phenomena. Despite this, in intuitive terms we might expect that the temporal properties of a stimulus that is paired with some outcome to be important. In particular, there is no previous research addressing the way that fixed or variable duration stimuli can affect overshadowing. In this chapter we report results which show that the degree of overshadowing depends on the distribution form - fixed or variable - of the overshadowing stimulus, and argue that conditioning is weaker under conditions of temporal uncertainty. These results are discussed in terms of models of conditioning and timing. We conclude that the temporal difference model, which has been extensively applied to the reinforcement learning problem in machine learning, accounts for the key findings of our study.

Publication Type: Book Section
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
R Medicine > RC Internal medicine > RC0321 Neuroscience. Biological psychiatry. Neuropsychiatry
Departments: School of Science & Technology > Computer Science
[thumbnail of alonso chap - temporal uncertainty.pdf]
Text - Published Version
Download (868kB) | Preview


Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email


Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login