Neural basis of reinforcement learning and decision making.

PubWeight™: 1.64‹?› | Rank: Top 3%

🔗 View Article (PMC 3490621)

Published in Annu Rev Neurosci on March 29, 2012

Authors

Daeyeol Lee1, Hyojung Seo, Min Whan Jung

Author Affiliations

1: Department of Neurobiology, Kavli Institute for Neuroscience, Yale University School of Medicine, New Haven, Connecticut 06510, USA. daeyeol.lee@yale.edu

Articles citing this

Brain-machine interface in chronic stroke rehabilitation: a controlled study. Ann Neurol (2013) 1.92

Cortical signals for rewarded actions and strategic exploration. Neuron (2013) 1.59

Effective reinforcement learning following cerebellar damage requires a balance between exploration and motor noise. Brain (2015) 1.50

Planning activity for internally generated reward goals in monkey amygdala neurons. Nat Neurosci (2015) 1.46

Distributed and Mixed Information in Monosynaptic Inputs to Dopamine Neurons. Neuron (2016) 1.43

Action versus valence in decision making. Trends Cogn Sci (2014) 1.17

The dorsomedial striatum encodes net expected return, critical for energizing performance vigor. Nat Neurosci (2013) 1.05

Learning where to look for a hidden target. Proc Natl Acad Sci U S A (2013) 1.01

Neural correlates of strategic reasoning during competitive games. Science (2014) 1.00

Decision making: from neuroscience to psychiatry. Neuron (2013) 0.99

Attention as an effect not a cause. Trends Cogn Sci (2014) 0.95

Novelty enhances visual salience independently of reward in the parietal lobe. J Neurosci (2014) 0.93

A functional difference in information processing between orbitofrontal cortex and ventral striatum during decision-making behaviour. Philos Trans R Soc Lond B Biol Sci (2014) 0.93

Bidirectional modulation of substantia nigra activity by motivational state. PLoS One (2013) 0.92

Dopamine-associated cached values are not sufficient as the basis for action selection. Proc Natl Acad Sci U S A (2014) 0.88

The role of uncertainty and reward on eye movements in a virtual driving task. J Vis (2012) 0.88

The visual corticostriatal loop through the tail of the caudate: circuitry and function. Front Syst Neurosci (2013) 0.87

Cortico-basal ganglia networks subserving goal-directed behavior mediated by conditional visuo-goal association. Front Neural Circuits (2013) 0.86

Role of dopamine D2 receptors in optimizing choice strategy in a dynamic and uncertain environment. Front Behav Neurosci (2014) 0.85

Modeling task control of eye movements. Curr Biol (2014) 0.85

Repeated acquisition and discrimination reversal in the squirrel monkey (Saimiri sciureus). Anim Cogn (2013) 0.84

Goal-direction and top-down control. Philos Trans R Soc Lond B Biol Sci (2014) 0.83

Arbitration between Action Strategies in Obsessive-Compulsive Disorder. Neuroscientist (2015) 0.83

Neural Basis of Strategic Decision Making. Trends Neurosci (2015) 0.83

Neurocognitive mechanisms underlying value-based decision-making: from core values to economic value. Front Hum Neurosci (2013) 0.82

Human Frontal-Subcortical Circuit and Asymmetric Belief Updating. J Neurosci (2015) 0.80

Neural correlates of temporal credit assignment in the parietal lobe. PLoS One (2014) 0.80

Neuronal selectivity for spatial positions of offers and choices in five reward regions. J Neurophysiol (2015) 0.80

Neural Mechanisms of Credit Assignment in a Multicue Environment. J Neurosci (2016) 0.80

Between the primate and 'reptilian' brain: Rodent models demonstrate the role of corticostriatal circuits in decision making. Neuroscience (2015) 0.79

Frontostriatal Gating of Tinnitus and Chronic Pain. Trends Cogn Sci (2015) 0.79

Prefrontal and striatal activity related to values of objects and locations. Front Neurosci (2012) 0.78

Uncovering the spatio-temporal dynamics of value-based decision-making in the human brain: a combined fMRI-EEG study. Philos Trans R Soc Lond B Biol Sci (2014) 0.78

Safety out of control: dopamine and defence. Behav Brain Funct (2016) 0.77

Insular neural system controls decision-making in healthy and methamphetamine-treated rats. Proc Natl Acad Sci U S A (2015) 0.77

Reward processing in neurodegenerative disease. Neurocase (2014) 0.77

Multiple brain networks contribute to the acquisition of bias in perceptual decision-making. Front Neurosci (2015) 0.76

Directional influence between the human amygdala and orbitofrontal cortex at the time of decision-making. PLoS One (2014) 0.76

A computational approach to "free will" constrained by the games we play. Front Integr Neurosci (2012) 0.76

Effects of fictive reward on rat's choice behavior. Sci Rep (2015) 0.76

Impact of Visual Corticostriatal Loop Disruption on Neural Processing within the Parahippocampal Place Area. J Neurosci (2016) 0.75

Motor Learning Enhances Use-Dependent Plasticity. J Neurosci (2017) 0.75

Remembrance of happy things past: positive autobiographical memories are intrinsically rewarding and valuable, but not in depression. Front Psychol (2015) 0.75

Performance Feedback Processing Is Positively Biased As Predicted by Attribution Theory. PLoS One (2016) 0.75

Parietal neurons encode expected gains in instrumental information. Proc Natl Acad Sci U S A (2017) 0.75

Integrating salience and value in decision making. Proc Natl Acad Sci U S A (2013) 0.75

Placebo Intervention Enhances Reward Learning in Healthy Individuals. Sci Rep (2017) 0.75

Control of gaze while walking: Task structure, reward, and uncertainty. J Vis (2017) 0.75

Dynamic Interaction between Reinforcement Learning and Attention in Multidimensional Environments. Neuron (2017) 0.75

Critical role for the mediodorsal thalamus in permitting rapid reward-guided updating in stochastic reward environments. Elife (2016) 0.75

Reward and Novelty Enhance Imagination of Future Events in a Motivational-Episodic Network. PLoS One (2015) 0.75

Neuronal activity in dorsomedial and dorsolateral striatum under the requirement for temporal credit assignment. Sci Rep (2016) 0.75

Lateral orbitofrontal cortex anticipates choices and integrates prior with current information. Nat Commun (2017) 0.75

How Social and Nonsocial Context Affects Stay/Leave Decision-Making: The Influence of Actual and Expected Rewards. PLoS One (2015) 0.75

Neural circuitry involved in quitting after repeated failures: role of the cingulate and temporal parietal junction. Sci Rep (2016) 0.75

Low Cognitive Impulsivity Is Associated with Better Gain and Loss Learning in a Probabilistic Decision-Making Task. Front Psychol (2017) 0.75

Neural reactivations during sleep determine network credit assignment. Nat Neurosci (2017) 0.75

Prefrontal Contribution to Decision-Making under Free-Choice Conditions. Front Neurosci (2017) 0.75

Complementary contributions of basolateral amygdala and orbitofrontal cortex to value learning under uncertainty. Elife (2017) 0.75

Articles cited by this

(truncated to the top 100)

Neural correlates of decision variables in parietal cortex. Nature (1999) 10.33

The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology (2010) 10.17

Matching behavior and the representation of value in the parietal cortex. Science (2004) 9.83

A framework for mesencephalic dopamine systems based on predictive Hebbian learning. J Neurosci (1996) 9.54

Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. J Neurophysiol (2001) 9.51

Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. J Neurosci (2002) 9.41

Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci (2005) 9.16

Neuronal population coding of movement direction. Science (1986) 8.79

The role of the basal ganglia in habit formation. Nat Rev Neurosci (2006) 8.68

Neurons in the orbitofrontal cortex encode economic value. Nature (2006) 8.59

The time course of perceptual choice: the leaky, competing accumulator model. Psychol Rev (2001) 8.46

Learning the value of information in an uncertain world. Nat Neurosci (2007) 8.31

Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. J Neurophysiol (1989) 7.86

Neural control of voluntary movement initiation. Science (1996) 7.78

Behavioral theories and the neurophysiology of reward. Annu Rev Psychol (2006) 7.61

Relative reward preference in primate orbitofrontal cortex. Nature (1999) 7.57

Uncertainty, neuromodulation, and attention. Neuron (2005) 7.48

Cognitive maps in rats and men. Psychol Rev (1948) 7.39

A neostriatal habit learning system in humans. Science (1996) 6.78

Lateral habenula as a source of negative reward signals in dopamine neurons. Nature (2007) 6.32

Dopamine in motivational control: rewarding, aversive, and alerting. Neuron (2010) 6.26

Unconscious determinants of free decisions in the human brain. Nat Neurosci (2008) 6.26

Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J Neurosci (2000) 6.02

Neural systems responding to degrees of uncertainty in human decision-making. Science (2005) 5.92

Remembering the past to imagine the future: the prospective brain. Nat Rev Neurosci (2007) 5.86

The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs. J Neurosci (1993) 5.77

Representation of action-specific reward values in the striatum. Science (2005) 5.76

Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology (1999) 5.62

Probabilistic decision making by slow reverberation in cortical circuits. Neuron (2002) 5.49

Dichotomous dopaminergic control of striatal synaptic plasticity. Science (2008) 5.47

Psychology and neurobiology of simple decisions. Trends Neurosci (2004) 5.42

States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron (2010) 5.30

Prefrontal cortex and decision making in a mixed-strategy game. Nat Neurosci (2004) 5.27

Functional role of the supplementary and pre-supplementary motor areas. Nat Rev Neurosci (2008) 5.20

The involvement of the orbitofrontal cortex in the experience of regret. Science (2004) 4.87

Synaptic reverberation underlying mnemonic persistent activity. Trends Neurosci (2001) 4.84

Modulation of striatal projection systems by dopamine. Annu Rev Neurosci (2011) 4.84

Neural correlates, computation and behavioural impact of decision confidence. Nature (2008) 4.80

Associative learning of social value. Nature (2008) 4.76

Entrainment of neocortical neurons and gamma oscillations by the hippocampal theta rhythm. Neuron (2008) 4.73

Activity in posterior parietal cortex is correlated with the relative subjective desirability of action. Neuron (2004) 4.60

Model-based influences on humans' choices and striatal prediction errors. Neuron (2011) 4.58

Neural signatures of economic preferences for risk and ambiguity. Neuron (2006) 4.54

Neuronal activity in primate dorsolateral and orbital prefrontal cortex during performance of a reward preference task. Eur J Neurosci (2003) 4.37

Cortico-basal ganglia circuit mechanism for a decision threshold in reaction time tasks. Nat Neurosci (2006) 4.36

Neural ensembles in CA3 transiently encode paths forward of the animal at a decision point. J Neurosci (2007) 4.32

Probabilistic population codes for Bayesian decision making. Neuron (2008) 4.25

Primate frontal eye fields. I. Single neurons discharging before saccades. J Neurophysiol (1985) 4.10

A cellular mechanism of reward-related learning. Nature (2001) 4.09

Regret and its avoidance: a neuroimaging study of choice behavior. Nat Neurosci (2005) 3.99

Deconstructing episodic memory with construction. Trends Cogn Sci (2007) 3.95

Memory related motor planning activity in posterior parietal cortex of macaque. Exp Brain Res (1988) 3.79

Reward processing in primate orbitofrontal cortex and basal ganglia. Cereb Cortex (2000) 3.75

Reward timing in the primary visual cortex. Science (2006) 3.36

Visual fixations and the computation and comparison of value in simple choice. Nat Neurosci (2010) 3.35

Parallel neural networks for learning sequential procedures. Trends Neurosci (1999) 3.35

Medial prefrontal cell activity signaling prediction errors of action values. Nat Neurosci (2007) 3.29

Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron (2010) 3.28

Decision making in recurrent neuronal circuits. Neuron (2008) 3.19

Ventromedial frontal cortex mediates affective shifting in humans: evidence from a reversal learning paradigm. Brain (2003) 3.11

Perseverative interference in monkeys following selective lesions of the inferior prefrontal convexity. Exp Brain Res (1970) 3.03

Value representations in the primate striatum during matching behavior. Neuron (2008) 3.02

Dopamine cells respond to predicted events during classical conditioning: evidence for eligibility traces in the reward-learning network. J Neurosci (2005) 2.97

Coherent theta oscillations and reorganization of spike timing in the hippocampal- prefrontal network upon learning. Neuron (2010) 2.96

Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game. J Neurosci (2007) 2.92

Human volition: towards a neuroscience of will. Nat Rev Neurosci (2008) 2.84

Neuronal representations of cognitive state: reward or attention? Trends Cogn Sci (2004) 2.84

Neurobiology of economic choice: a good-based model. Annu Rev Neurosci (2011) 2.81

The globus pallidus sends reward-related signals to the lateral habenula. Neuron (2008) 2.81

Neural variability in premotor cortex provides a signature of motor preparation. J Neurosci (2006) 2.80

Neural signature of fictive learning signals in a sequential investment task. Proc Natl Acad Sci U S A (2007) 2.70

Basal ganglia orient eyes to reward. J Neurophysiol (2006) 2.55

Orbitofrontal lesions in rats impair reversal but not acquisition of go, no-go odor discriminations. Neuroreport (2002) 2.44

Prefrontal coding of temporally discounted values during intertemporal choice. Neuron (2008) 2.39

Value-based modulations in human visual cortex. Neuron (2008) 2.35

Fictive reward signals in the anterior cingulate cortex. Science (2009) 2.33

Reinforcement learning: the good, the bad and the ugly. Curr Opin Neurobiol (2008) 2.24

Game theory and neural basis of social decision making. Nat Neurosci (2008) 2.24

Coding of reward risk by orbitofrontal neurons is mostly distinct from coding of reward value. Neuron (2010) 2.17

Localization of D1 and D2 dopamine receptors in brain with subtype-specific antibodies. Proc Natl Acad Sci U S A (1993) 2.10

Moment-to-moment tracking of state value in the amygdala. J Neurosci (2008) 2.02

Distinct roles of rodent orbitofrontal and medial prefrontal cortex in decision making. Neuron (2010) 1.99

Neural computations underlying action-based decision making in the human brain. Proc Natl Acad Sci U S A (2009) 1.98

Dopamine transporter immunoreactivity in monkey cerebral cortex: regional, laminar, and ultrastructural localization. J Comp Neurol (2001) 1.95

What we know and do not know about the functions of the orbitofrontal cortex after 20 years of cross-species studies. J Neurosci (2007) 1.93

Separating value from choice: delay discounting activity in the lateral intraparietal area. J Neurosci (2010) 1.93

Similarity effect and optimal control of multiple-choice decision making. Neuron (2008) 1.88

Ventral striatal neurons encode the value of the chosen action in rats deciding between differently delayed or sized rewards. J Neurosci (2009) 1.85

Heterogeneous reward signals in prefrontal cortex. Curr Opin Neurobiol (2010) 1.84

Role of striatum in updating values of chosen actions. J Neurosci (2009) 1.83

Single-unit recording and stimulation in superior colliculus of the alert rhesus monkey. J Neurophysiol (1972) 1.81

Dissociating valuation and saliency signals during decision-making. Cereb Cortex (2010) 1.75

Beyond working memory: the role of persistent activity in decision making. Trends Cogn Sci (2010) 1.73

Lateral intraparietal cortex and reinforcement learning during a mixed-strategy game. J Neurosci (2009) 1.72

A biophysically based neural model of matching law behavior: melioration by stochastic synapses. J Neurosci (2006) 1.72

Heterogeneous coding of temporally discounted values in the dorsal and ventral striatum during intertemporal choice. Neuron (2011) 1.72

Visual and anticipatory bias in three cortical eye fields of the monkey during an adaptive decision-making task. J Neurosci (2002) 1.71

Activity of superior colliculus in behaving monkey. 3. Cells discharging before eye movements. J Neurophysiol (1972) 1.70

Distributed coding of actual and hypothetical outcomes in the orbital and dorsolateral prefrontal cortex. Neuron (2011) 1.69

Neural dissociation of delay and uncertainty in intertemporal choice. J Neurosci (2008) 1.68

Articles by these authors

Neural circuits and mechanisms involved in Pavlovian fear conditioning: a critical review. Neurosci Biobehav Rev (2005) 2.91

Distinct roles of rodent orbitofrontal and medial prefrontal cortex in decision making. Neuron (2010) 1.99

Role of striatum in updating values of chosen actions. J Neurosci (2009) 1.83

A reservoir of time constants for memory traces in cortical neurons. Nat Neurosci (2011) 1.66

Cortical signals for rewarded actions and strategic exploration. Neuron (2013) 1.59

Mechanisms of reinforcement learning and decision making in the primate dorsolateral prefrontal cortex. Ann N Y Acad Sci (2007) 1.55

Role of rodent secondary motor cortex in value-based action selection. Nat Neurosci (2011) 1.29

Neural correlates of interval timing in rodent prefrontal cortex. J Neurosci (2013) 1.13

Encoding of action history in the rat ventral striatum. J Neurophysiol (2007) 1.11

ERK1/2 is an endogenous negative regulator of the gamma-secretase activity. FASEB J (2005) 1.09

Enhanced proliferation of progenitor cells following long-term potentiation induction in the rat dentate gyrus. Neurobiol Learn Mem (2006) 1.09

Lovastatin enhances Abeta production and senile plaque deposition in female Tg2576 mice. Neurobiol Aging (2003) 1.08

Signals for previous goal choice persist in the dorsomedial, but not dorsolateral striatum of rats. J Neurosci (2013) 1.00

Valuation of uncertain and delayed rewards in primate prefrontal cortex. Neural Netw (2009) 0.99

Variation in effective stimulus patterns for induction of long-term potentiation across different layers of rat entorhinal cortex. J Neurosci (2002) 0.98

Role of active movement in place-specific firing of hippocampal neurons. Hippocampus (2005) 0.97

Model-based reinforcement learning under concurrent schedules of reinforcement in rodents. Learn Mem (2009) 0.91

Human serum transthyretin levels correlate inversely with Alzheimer's disease. J Alzheimers Dis (2011) 0.89

Inactivation of medial prefrontal cortex impairs time interval discrimination in rats. Front Behav Neurosci (2009) 0.88

Amyloid beta peptide directly inhibits PKC activation. Mol Cell Neurosci (2004) 0.86

Augmentation by zinc of NMDA receptor-mediated synaptic responses in CA1 of rat hippocampal slices: mediation by Src family tyrosine kinases. Synapse (2002) 0.86

Involvement of calcium-mediated apoptotic signals in H2O2-induced MIN6N8a cell death. Eur J Pharmacol (2006) 0.83

Induction of homosynaptic long-term depression in entorhinal cortex. Brain Res (2002) 0.82

Effect of orbitofrontal cortex lesions on temporal discounting in rats. Behav Brain Res (2013) 0.82

Neuroprotective effects of constituents of the oriental crude drugs, Rhodiola sacra, R. sachalinensis and Tokaku-joki-to, against beta-amyloid toxicity, oxidative stress and apoptosis. Biol Pharm Bull (2002) 0.82

Auditory Cortex is Important in the Extinction of Two Different Tone-Based Conditioned Fear Memories in Rats. Front Behav Neurosci (2010) 0.81

Differential regulation of observational fear and neural oscillations by serotonin and dopamine in the mouse anterior cingulate cortex. Psychopharmacology (Berl) (2014) 0.80

Scopolamine-induced learning impairment reversed by physostigmine in zebrafish. Neurosci Res (2010) 0.80

A computer vision-based automated Figure-8 maze for working memory test in rodents. J Neurosci Methods (2006) 0.80

Role of dentate gyrus in aligning internal spatial map to external landmark. Learn Mem (2009) 0.79

Disruption of dentate gyrus blocks effect of visual input on spatial firing of CA1 neurons. J Neurosci (2012) 0.79

The prefrontal cortex and hybrid learning during iterative competitive games. Ann N Y Acad Sci (2011) 0.79

LTD induction suppresses LTP-induced hippocampal adult neurogenesis. Neuroreport (2009) 0.78

Amyloid precursor protein processing is separately regulated by protein kinase C and tyrosine kinase in human astrocytes. Neurosci Lett (2002) 0.77

Single-nucleotide resolution of RNAs up to 59 nucleotides by high-performance liquid chromatography. Anal Biochem (2012) 0.77

Attaching values to actions: action and outcome encoding in the primate caudate nucleus. J Neurosci (2008) 0.77

Neuroscience: Persistent feedback. Nature (2009) 0.76

Effects of methamphetamine on single unit activity in rat medial prefrontal cortex in vivo. Neural Plast (2007) 0.76

Neural activity in mediodorsal nucleus of thalamus in rats performing a working memory task. Front Neural Circuits (2013) 0.76

Information transmission by stimulus-dependent modulation of noise correlation. Neuroreport (2008) 0.75

Stimulus-induced reduction of noise correlation in rat prefrontal cortex. Neuroreport (2011) 0.75