Value learning through reinforcement: The basics of dopamine and reinforcement learning

N.D. Daw, P.N. Tobler

Research output: Chapter in Book/Report/Conference proceedingChapterScientificpeer-review

37 Citations (Scopus)

Abstract

This chapter provides an overview of reinforcement learning and temporal difference learning and relates these topics to the firing properties of midbrain dopamine neurons. First, we review the RescorlaWagner learning rule and basic learning phenomena, such as blocking, which the rule explains. Then we introduce the basic functional anatomy of the dopamine system and review studies that reveal a close correspondence between responses emitted by dopamine neurons and signals predicted by reinforcement learning. Finally, we introduce the generalization of the RescorlaWagner rule to sequential redictions as provided by temporal difference learning, and discuss its application to phasic activation changes of dopamine neurons. Subsequent chapters in this section deal with more advanced topics in reinforcement learning and presume that the reader is familiar with material covered in this chapter.
Original languageEnglish
Title of host publicationNeuroeconomics (2nd edition)
EditorsP.W. Glimcher, E. Fehr
Place of PublicationOxford
PublisherAcademic Press
Pages283-298
Number of pages560
ISBN (Print)9780124160088
Publication statusPublished - 2013

Fingerprint

Dive into the research topics of 'Value learning through reinforcement: The basics of dopamine and reinforcement learning'. Together they form a unique fingerprint.

Cite this