Dopamine prediction error responses integrate subjective value from different reward dimensions.

PubWeight™: 1.53‹?› | Rank: Top 4%

🔗 View Article (PMC 3926061)

Published in Proc Natl Acad Sci U S A on January 22, 2014

Authors

Armin Lak1, William R Stauffer, Wolfram Schultz

Author Affiliations

1: Department of Physiology, Development, and Neuroscience, University of Cambridge, Cambridge CB2 3DY, United Kingdom.

Articles citing this

A new framework for cortico-striatal plasticity: behavioural theory meets in vitro data at the reinforcement-action interface. PLoS Biol (2015) 2.18

A Corticostriatal Path Targeting Striosomes Controls Decision-Making under Conflict. Cell (2015) 1.70

Planning activity for internally generated reward goals in monkey amygdala neurons. Nat Neurosci (2015) 1.46

Dopamine Neuron-Specific Optogenetic Stimulation in Rhesus Macaques. Cell (2016) 1.39

Neuronal Reward and Decision Signals: From Theories to Data. Physiol Rev (2015) 1.24

Orbitofrontal cortex uses distinct codes for different choice attributes in decisions motivated by curiosity. Neuron (2015) 1.16

Dopamine reward prediction error responses reflect marginal utility. Curr Biol (2014) 1.11

Dopamine reward prediction-error signalling: a two-component response. Nat Rev Neurosci (2016) 1.01

The problem with value. Neurosci Biobehav Rev (2014) 0.99

Mesolimbic dopamine dynamically tracks, and is causally linked to, discrete aspects of value-based decision making. Biol Psychiatry (2014) 0.95

Midbrain dopamine neurons compute inferred and cached value prediction errors in a common framework. Elife (2016) 0.93

Phasic dopamine signals: from subjective reward value to formal economic utility. Curr Opin Behav Sci (2015) 0.92

Dopamine antagonism decreases willingness to expend physical, but not cognitive, effort: a comparison of two rodent cost/benefit decision-making tasks. Neuropsychopharmacology (2014) 0.89

Dopamine-associated cached values are not sufficient as the basis for action selection. Proc Natl Acad Sci U S A (2014) 0.88

Learning the specific quality of taste reinforcement in larval Drosophila. Elife (2015) 0.87

Reward functions of the basal ganglia. J Neural Transm (Vienna) (2016) 0.87

Toward sophisticated basal ganglia neuromodulation: Review on basal ganglia deep brain stimulation. Neurosci Biobehav Rev (2015) 0.85

Economic choices reveal probability distortion in macaque monkeys. J Neurosci (2015) 0.84

Advances from neuroimaging studies in eating disorders. CNS Spectr (2015) 0.83

Components and characteristics of the dopamine reward utility signal. J Comp Neurol (2015) 0.83

Could dopamine agonists aid in drug development for anorexia nervosa? Front Nutr (2014) 0.82

Dopamine reward prediction error coding. Dialogues Clin Neurosci (2016) 0.82

LinkRbrain: multi-scale data integrator of the brain. J Neurosci Methods (2014) 0.82

Monetary, Food, and Social Rewards Induce Similar Pavlovian-to-Instrumental Transfer Effects. Front Behav Neurosci (2017) 0.80

A network model of basal ganglia for understanding the roles of dopamine and serotonin in reward-punishment-risk based decision making. Front Comput Neurosci (2015) 0.80

The influence of contextual reward statistics on risk preference. Neuroimage (2015) 0.80

Utility functions predict variance and skewness risk preferences in monkeys. Proc Natl Acad Sci U S A (2016) 0.79

Dynamic mesolimbic dopamine signaling during action sequence learning and expectation violation. Sci Rep (2016) 0.79

A neuronal reward inequity signal in primate striatum. J Neurophysiol (2015) 0.77

Mesolimbic Dopamine Encodes Prediction Errors in a State-Dependent Manner. Cell Rep (2016) 0.77

Insular neural system controls decision-making in healthy and methamphetamine-treated rats. Proc Natl Acad Sci U S A (2015) 0.77

To Act or Not to Act: Endocannabinoid/Dopamine Interactions in Decision-Making. Front Behav Neurosci (2015) 0.76

A role for orbitofrontal neurons in risky decisions. J Neurosci (2015) 0.75

Monkeys choose as if maximizing utility compatible with basic principles of revealed preference theory. Proc Natl Acad Sci U S A (2017) 0.75

The Dopamine Prediction Error: Contributions to Associative Models of Reward Learning. Front Psychol (2017) 0.75

Dopamine neurons learn relative chosen value from probabilistic rewards. Elife (2016) 0.75

Performance error-related activity in monkey striatum during social interactions. Sci Rep (2016) 0.75

Forgetting in Reinforcement Learning Links Sustained Dopamine Signals to Motivation. PLoS Comput Biol (2016) 0.75

Ventral Midbrain NMDA Receptor Blockade: From Enhanced Reward and Dopamine Inactivation. Front Behav Neurosci (2016) 0.75

A Cognitive Model Based on Neuromodulated Plasticity. Comput Intell Neurosci (2016) 0.75

Economic risk coding by single neurons in the orbitofrontal cortex. J Physiol Paris (2014) 0.75

Subjective utility moderates bidirectional effects of conflicting motivations on pain perception. Sci Rep (2017) 0.75

Articles cited by this

A neural substrate of prediction and reward. Science (1997) 31.30

Matching behavior and the representation of value in the parietal cortex. Science (2004) 9.83

Discrete coding of reward probability and uncertainty by dopamine neurons. Science (2003) 9.54

A discounting framework for choice with delayed and probabilistic rewards. Psychol Bull (2004) 8.83

Phasic firing in dopaminergic neurons is sufficient for behavioral conditioning. Science (2009) 8.76

Neurons in the orbitofrontal cortex encode economic value. Nature (2006) 8.59

A framework for studying the neurobiology of value-based decision making. Nat Rev Neurosci (2008) 8.12

Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron (2005) 7.56

Regulation of parkinsonian motor behaviours by optogenetic control of basal ganglia circuitry. Nature (2010) 7.35

Adaptive coding of reward value by dopamine neurons. Science (2005) 6.71

Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature (2009) 6.35

Representation of action-specific reward values in the striatum. Science (2005) 5.76

Modulation of memory fields by dopamine D1 receptors in prefrontal cortex. Nature (1995) 5.63

Dichotomous dopaminergic control of striatal synaptic plasticity. Science (2008) 5.47

Neuron-type-specific signals for reward and punishment in the ventral tegmental area. Nature (2012) 5.37

Neural economics and the biological substrates of valuation. Neuron (2002) 5.37

Whole-brain mapping of direct inputs to midbrain dopamine neurons. Neuron (2012) 4.59

A cellular mechanism of reward-related learning. Nature (2001) 4.09

Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task. J Neurosci (1993) 3.83

Inverted-U dopamine D1 receptor actions on prefrontal neurons engaged in working memory. Nat Neurosci (2007) 3.82

Medial prefrontal cell activity signaling prediction errors of action values. Nat Neurosci (2007) 3.29

Prefrontal cortical projections to the hypothalamus in macaque monkeys. J Comp Neurol (1998) 2.91

GABA neurons of the VTA drive conditioned place aversion. Neuron (2012) 2.86

Neurobiology of economic choice: a good-based model. Annu Rev Neurosci (2011) 2.81

Activation of VTA GABA neurons disrupts reward consumption. Neuron (2012) 2.80

Influence of reward delays on responses of dopamine neurons. J Neurosci (2008) 2.78

Free choice activates a decision circuit between frontal and parietal cortex. Nature (2008) 2.75

A causal link between prediction errors, dopamine neurons and learning. Nat Neurosci (2013) 2.68

Double dissociation of value computations in orbitofrontal and anterior cingulate neurons. Nat Neurosci (2011) 2.55

Dopamine neurons can represent context-dependent prediction error. Neuron (2004) 2.51

Negative reward signals from the lateral habenula to dopamine neurons are mediated by rostromedial tegmental nucleus in primates. J Neurosci (2011) 2.19

Nonlinear relationship between impulse flow and dopamine released by rat midbrain dopaminergic neurons as studied by in vivo electrochemistry. Neuroscience (1988) 2.08

Dopamine transporter immunoreactivity in monkey cerebral cortex: regional, laminar, and ultrastructural localization. J Comp Neurol (2001) 1.95

Reward value-based gain control: divisive normalization in parietal cortex. J Neurosci (2011) 1.85

Transient stimulation of distinct subpopulations of striatal neurons mimics changes in action value. Nat Neurosci (2012) 1.79

Characterization of the dopaminergic innervation of the primate frontal cortex using a dopamine-specific antibody. Cereb Cortex (1993) 1.38

The organization of midbrain projections to the ventral striatum in the primate. Neuroscience (1994) 1.37

The primate amygdala combines information about space and value. Nat Neurosci (2013) 1.20

Multiple timescales of memory in lateral habenula and dopamine neurons. Neuron (2010) 1.17

The role of prefrontal dopamine D1 receptors in the neural mechanisms of associative learning. Neuron (2012) 1.11

Hypothalamic neuron involvement in integration of reward, aversion, and cue signals. J Neurophysiol (1986) 1.02

Effects of hunger on the responses of neurons in the lateral hypothalamus to the sight and taste of food. Exp Neurol (1976) 0.92

Bidirectional modulation of substantia nigra activity by motivational state. PLoS One (2013) 0.92

Articles by these authors

Discrete coding of reward probability and uncertainty by dopamine neurons. Science (2003) 9.54

Adaptive coding of reward value by dopamine neurons. Science (2005) 6.71

Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors. J Neurosci (2008) 5.64

Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. J Neurophysiol (2006) 3.53

Influence of reward delays on responses of dopamine neurons. J Neurosci (2008) 2.78

Effects of expectations for different reward magnitudes on neuronal activity in primate striatum. J Neurophysiol (2003) 2.77

The temporal precision of reward prediction in dopamine neurons. Nat Neurosci (2008) 2.38

Neural correlates of value, risk, and risk aversion contributing to decision making under risk. J Neurosci (2009) 2.29

Coding of predicted reward omission by dopamine neurons in a conditioned inhibition paradigm. J Neurosci (2003) 2.26

Coding of reward risk by orbitofrontal neurons is mostly distinct from coding of reward value. Neuron (2010) 2.17

Transformation of stimulus value signals into motor commands during simple choice. Proc Natl Acad Sci U S A (2011) 1.94

Neural mechanisms of observational learning. Proc Natl Acad Sci U S A (2010) 1.70

Adaptation of reward sensitivity in orbitofrontal neurons. J Neurosci (2010) 1.66

Risk-dependent reward value signal in human prefrontal cortex. Proc Natl Acad Sci U S A (2009) 1.63

Refinement of the use of food and fluid control as motivational tools for macaques used in behavioural neuroscience research: report of a Working Group of the NC3Rs. J Neurosci Methods (2010) 1.61

Human neural learning depends on reward prediction errors in the blocking paradigm. J Neurophysiol (2005) 1.46

Relative reward processing in primate striatum. Exp Brain Res (2005) 1.42

Temporally extended dopamine responses to perceptually demanding reward-predictive stimuli. J Neurosci (2010) 1.38

Influences of rewarding and aversive outcomes on activity in macaque lateral prefrontal cortex. Neuron (2006) 1.37

Learning-related human brain activations reflecting individual finances. Neuron (2007) 1.30

Neuronal distortions of reward probability without choice. J Neurosci (2008) 1.22

Rewarding properties of visual stimuli. Exp Brain Res (2005) 1.20

Short-term temporal discounting of reward value in human ventral striatum. J Neurophysiol (2009) 1.16

The role of the striatum in social behavior. Front Neurosci (2013) 1.05

Reward magnitude coding in primate amygdala neurons. J Neurophysiol (2010) 1.05

Evidence that the delay-period activity of dopamine neurons corresponds to reward uncertainty rather than backpropagating TD errors. Behav Brain Funct (2005) 1.03

Responses of amygdala neurons to positive reward-predicting stimuli depend on background reward (contingency) rather than stimulus-reward pairing (contiguity). J Neurophysiol (2009) 1.02

Striatal BOLD Response Reflects the Impact of Herd Information on Financial Decisions. Front Hum Neurosci (2010) 1.00

Prediction of economic choice by primate amygdala neurons. Proc Natl Acad Sci U S A (2012) 0.99

The human brain encodes event frequencies while forming subjective beliefs. J Neurosci (2013) 0.96

Monitoring extracellular pH, oxygen, and dopamine during reward delivery in the striatum of primates. Front Behav Neurosci (2012) 0.93

BOLD responses in reward regions to hypothetical and imaginary monetary rewards. Neuroimage (2011) 0.92

Operant conditioning of primate prefrontal neurons. J Neurophysiol (2010) 0.92

Activity of striatal neurons reflects social action and own reward. Proc Natl Acad Sci U S A (2013) 0.90

Surface immobilization of neural adhesion molecule L1 for improving the biocompatibility of chronic neural probes: In vitro characterization. Acta Biomater (2008) 0.88

Sensitivity to temporal reward structure in amygdala neurons. Curr Biol (2012) 0.86

Risk prediction error coding in orbitofrontal neurons. J Neurosci (2013) 0.82

Enhanced differentiation of embryonic and neural stem cells to neuronal fates on laminin peptides doped polypyrrole. Macromol Biosci (2010) 0.81

Appetitive and aversive taste conditioning in a computer game influences real-world decision making and subsequent activation in insular cortex. J Neurosci (2009) 0.78

Timing in reward and decision processes. Philos Trans R Soc Lond B Biol Sci (2014) 0.77