Prediction Error in Reinforcement Learning: A Meta-analysis of Neuroimaging studies

J. Garrison, B. Erdeniz, D.J. Done

Research output: Contribution to journalArticlepeer-review

215 Citations (Scopus)
256 Downloads (Pure)

Abstract

Activation likelihood estimation (ALE) meta-analyses were used to examine the neural correlates of prediction error in reinforcement learning. The findings are interpreted in the light of current computational models of learning and action selection. In this context, particular consideration is given to the comparison of activation patterns from studies using instrumental and Pavlovian conditioning, and where reinforcement involved rewarding or punishing feedback. The striatum was the key brain area encoding for prediction error, with activity encompassing dorsal and ventral regions for instrumental and Pavlovian reinforcement alike, a finding which challenges the functional separation of the striatum into a dorsal ‘actor’ and a ventral ‘critic’. Prediction error activity was further observed in diverse areas of predominantly anterior cerebral cortex including medial prefrontal cortex and anterior cingulate cortex. Distinct patterns of prediction error activity were found for studies using rewarding and aversive reinforcers; reward prediction errors were observed primarily in the striatum while aversive prediction errors were found more widely including insula and habenula.
Original languageEnglish
Pages (from-to)1297-1310
JournalNeuroscience and Biobehavioral Reviews
Volume37
Issue number7
DOIs
Publication statusPublished - Aug 2013

Fingerprint

Dive into the research topics of 'Prediction Error in Reinforcement Learning: A Meta-analysis of Neuroimaging studies'. Together they form a unique fingerprint.

Cite this