Calculating consequences: brain systems that encode the causal effects of actions.

PubWeight™: 2.05‹?› | Rank: Top 2%

🔗 View Article (PMC 3071565)

Published in J Neurosci on June 25, 2008

Authors

Saori C Tanaka1, Bernard W Balleine, John P O'Doherty

Author Affiliations

1: Division of the Humanities and Social Sciences and Computation and Neural Systems Program, California Institute of Technology, Pasadena, California 91125, USA.

Articles citing this

Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology (2010) 6.00

A specific role for posterior dorsolateral striatum in human habit learning. Eur J Neurosci (2009) 3.25

Goal-directed and habitual control in the basal ganglia: implications for Parkinson's disease. Nat Rev Neurosci (2010) 3.05

Disruption in the balance between goal-directed behavior and habit learning in obsessive-compulsive disorder. Am J Psychiatry (2011) 2.24

Neural computations underlying arbitration between model-based and model-free learning. Neuron (2014) 2.20

Mapping value based planning and extensively trained choice in the human brain. Nat Neurosci (2012) 2.09

Goals and habits in the brain. Neuron (2013) 2.08

Orbitofrontal and striatal circuits dynamically encode the shift between goal-directed and habitual actions. Nat Commun (2013) 1.70

Functional neuroimaging of avoidance habits in obsessive-compulsive disorder. Am J Psychiatry (2014) 1.56

Functional disturbances within frontostriatal circuits across multiple childhood psychopathologies. Am J Psychiatry (2009) 1.55

Differential engagement of the ventromedial prefrontal cortex by goal-directed and habitual behavior toward food pictures in humans. J Neurosci (2009) 1.53

Born to choose: the origins and value of the need for control. Trends Cogn Sci (2010) 1.51

Disorders of compulsivity: a common bias towards learning habits. Mol Psychiatry (2014) 1.48

Long-lasting adaptations of the NR2B-containing NMDA receptors in the dorsomedial striatum play a crucial role in alcohol consumption and relapse. J Neurosci (2010) 1.46

Differentiating neural systems mediating the acquisition vs. expression of goal-directed and habitual behavioral control. Eur J Neurosci (2015) 1.43

Contributions of the striatum to learning, motivation, and performance: an associative account. Trends Cogn Sci (2012) 1.42

Goal-directed decision making as probabilistic inference: a computational framework and potential neural correlates. Psychol Rev (2012) 1.27

Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients. Transl Psychiatry (2013) 1.21

Contextual control of instrumental actions and habits. J Exp Psychol Anim Learn Cogn (2014) 1.21

Dissociable regulation of instrumental action within mouse prefrontal cortex. Eur J Neurosci (2010) 1.19

Neural correlates of instrumental contingency learning: differential effects of action-reward conjunction and disjunction. J Neurosci (2011) 1.16

Neural correlates of stimulus-response and response-outcome associations in dorsolateral versus dorsomedial striatum. Front Integr Neurosci (2010) 1.13

Interoceptive effects of alcohol require mGlu5 receptor activity in the nucleus accumbens. J Neurosci (2009) 1.08

Goal-directed learning and obsessive-compulsive disorder. Philos Trans R Soc Lond B Biol Sci (2014) 1.07

Instrumental uncertainty as a determinant of behavior under interval schedules of reinforcement. Front Integr Neurosci (2010) 1.07

Individual differences in risk preference predict neural responses during financial decision-making. Brain Res (2009) 1.05

The behavioral and neural mechanisms underlying the tracking of expertise. Neuron (2013) 1.00

Adapting to dynamic stimulus-response values: differential contributions of inferior frontal, dorsomedial, and dorsolateral regions of prefrontal cortex to decision making. J Neurosci (2009) 1.00

Human dorsal striatum encodes prediction errors during observational learning of instrumental actions. J Cogn Neurosci (2011) 0.97

Functional, structural, and emotional correlates of impaired insight in cocaine addiction. JAMA Psychiatry (2014) 0.97

Translational studies of goal-directed action as a framework for classifying deficits across psychiatric disorders. Front Syst Neurosci (2014) 0.96

Medial prefrontal cortex inversely regulates toluene-induced changes in markers of synaptic plasticity of mesolimbic dopamine neurons. J Neurosci (2013) 0.92

Operant conditioning of primate prefrontal neurons. J Neurophysiol (2010) 0.92

Dissociable brain systems mediate vicarious learning of stimulus-response and action-outcome contingencies. J Neurosci (2012) 0.90

Frontostriatal mechanisms in instruction-based learning as a hallmark of flexible goal-directed behavior. Front Psychol (2012) 0.89

Fronto-striatal organization: Defining functional and microstructural substrates of behavioural flexibility. Cortex (2015) 0.87

Disconnection of the entorhinal cortex and dorsomedial striatum impairs the sensitivity to instrumental contingency degradation. Neuropsychopharmacology (2010) 0.87

Translational approaches to obsessive-compulsive disorder: from animal models to clinical treatment. Br J Pharmacol (2011) 0.86

Imaging volition: what the brain can tell us about the will. Exp Brain Res (2013) 0.86

The Good, the Bad, and the Irrelevant: Neural Mechanisms of Learning Real and Hypothetical Rewards and Effort. J Neurosci (2015) 0.86

Beyond the Medial Regions of Prefrontal Cortex in the Regulation of Fear and Anxiety. Front Syst Neurosci (2016) 0.85

Dorsal and ventral streams: the distinct role of striatal subregions in the acquisition and performance of goal-directed actions. Neurobiol Learn Mem (2013) 0.85

A role for the striatum in regret-related choice repetition. J Cogn Neurosci (2010) 0.84

Common neural mechanisms underlying reversal learning by reward and punishment. PLoS One (2013) 0.83

Value and probability coding in a feedback-based learning task utilizing food rewards. J Neurophysiol (2014) 0.83

Arbitration between Action Strategies in Obsessive-Compulsive Disorder. Neuroscientist (2015) 0.83

Adolescent stimulation of D2 receptors alters the maturation of dopamine-dependent goal-directed behavior. Neuropsychopharmacology (2013) 0.82

Neural correlates of the divergence of instrumental probability distributions. J Neurosci (2013) 0.82

Neural correlates of emotion regulation in the ventral prefrontal cortex and the encoding of subjective value and economic utility. Front Psychiatry (2014) 0.82

Tryptophan Depletion Promotes Habitual over Goal-Directed Control of Appetitive Responding in Humans. Int J Neuropsychopharmacol (2015) 0.82

The role of the rat medial prefrontal cortex in adapting to changes in instrumental contingency. PLoS One (2012) 0.81

Distinct Changes in CREB Phosphorylation in Frontal Cortex and Striatum During Contingent and Non-Contingent Performance of a Visual Attention Task. Front Behav Neurosci (2011) 0.81

Behavioral contagion during learning about another agent's risk-preferences acts on the neural representation of decision-risk. Proc Natl Acad Sci U S A (2016) 0.80

Action-value comparisons in the dorsolateral prefrontal cortex control choice between goal-directed actions. Nat Commun (2014) 0.80

Intelligence moderates neural responses to monetary reward and punishment. J Neurophysiol (2014) 0.80

Model-based action planning involves cortico-cerebellar and basal ganglia networks. Sci Rep (2016) 0.78

Navigating complex decision spaces: Problems and paradigms in sequential choice. Psychol Bull (2013) 0.78

The simple act of choosing influences declarative memory. J Neurosci (2015) 0.78

Human processing of behaviorally relevant and irrelevant absence of expected rewards: a high-resolution ERP study. PLoS One (2011) 0.78

Cholinergic Interneurons Use Orbitofrontal Input to Track Beliefs about Current State. J Neurosci (2016) 0.78

Characterizing the associative content of brain structures involved in habitual and goal-directed actions in humans: a multivariate FMRI study. J Neurosci (2015) 0.78

Right external globus pallidus changes are associated with altered causal awareness in youth with depression. Transl Psychiatry (2015) 0.78

Translational Research on Habit and Alcohol. Curr Addict Rep (2016) 0.78

On causality of extreme events. PeerJ (2016) 0.77

Impulsive action: emotional impulses and their control. Front Psychol (2014) 0.77

General Habit Propensity Relates to the Sensation Seeking Subdomain of Impulsivity But Not Obesity. Front Behav Neurosci (2016) 0.77

Loss of brain graph network efficiency in alcohol dependence. Addict Biol (2015) 0.76

Distinct fronto-striatal couplings reveal the double-faced nature of response-outcome relations in instruction-based learning. Cogn Affect Behav Neurosci (2015) 0.76

Orbitofrontal and caudate volumes in cannabis users: a multi-site mega-analysis comparing dependent versus non-dependent users. Psychopharmacology (Berl) (2017) 0.75

Impaired causal awareness and associated cortical-basal ganglia structural changes in youth psychiatric disorders. Neuroimage Clin (2016) 0.75

Role of the Perigenual Anterior Cingulate and Orbitofrontal Cortex in Contingency Learning in the Marmoset. Cereb Cortex (2016) 0.75

Arbitration between controlled and impulsive choices. Neuroimage (2015) 0.75

Cognitive inflexibility in Obsessive-Compulsive Disorder. Neuroscience (2016) 0.75

Lateral, not medial, prefrontal cortex contributes to punishment and aversive instrumental learning. Learn Mem (2016) 0.75

Specialized Representations of Value in the Orbital and Ventrolateral Prefrontal Cortex: Desirability versus Availability of Outcomes. Neuron (2017) 0.75

Creature of Habit: A self-report measure of habitual routines and automatic tendencies in everyday life. Pers Individ Dif (2017) 0.75

Articles cited by this

Searching for a baseline: functional imaging and the resting human brain. Nat Rev Neurosci (2001) 18.23

Insensitivity to future consequences following damage to human prefrontal cortex. Cognition (1994) 14.92

The correlation-based law of effect. J Exp Anal Behav (1973) 11.90

Abstract reward and punishment representations in the human orbitofrontal cortex. Nat Neurosci (2001) 9.49

Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science (2003) 6.76

Neural responses during anticipation of a primary taste reward. Neuron (2002) 6.40

The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature (2006) 5.94

Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology (1999) 5.62

Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning. Nat Neurosci (1998) 5.20

The role of the dorsomedial striatum in instrumental conditioning. Eur J Neurosci (2005) 4.95

A region of mesial prefrontal cortex tracks monetarily rewarding outcomes: characterization with rapid event-related fMRI. Neuroimage (2003) 4.85

The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans. J Neurosci (2006) 4.55

Emotion-related learning in patients with social and emotional changes associated with frontal lobe damage. J Neurol Neurosurg Psychiatry (1994) 4.34

Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature (2005) 3.84

Modulation of caudate activity by action contingency. Neuron (2004) 3.60

Coordination of actions and habits in the medial prefrontal cortex of rats. Cereb Cortex (2003) 3.54

Neuronal correlates of goal-based motor selection in the prefrontal cortex. Science (2003) 3.53

Determining the neural substrates of goal-directed learning in the human brain. J Neurosci (2007) 3.31

The effect of contingency upon the appetitive conditioning of free-operant behavior. J Exp Anal Behav (1980) 2.77

Appetitive and aversive olfactory learning in humans studied using event-related functional magnetic resonance imaging. J Neurosci (2002) 2.65

The role of prelimbic cortex in instrumental conditioning. Behav Brain Res (2003) 2.51

Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits. Physiol Behav (2005) 2.50

Still at the choice-point: action selection and initiation in instrumental conditioning. Ann N Y Acad Sci (2007) 1.99

Some cognitive effects of frontal-lobe lesions in man. Philos Trans R Soc Lond B Biol Sci (1982) 1.79

The effect of lesions of the insular cortex on instrumental conditioning: evidence for a role in incentive memory. J Neurosci (2000) 1.58

Changes in behavior-related neuronal activity in the striatum during learning. Trends Neurosci (2003) 1.53

Prefrontal dysfunction in depressed patients performing a complex planning task: a study using positron emission tomography. Psychol Med (1997) 1.48

Articles by these authors

Cortical substrates for exploratory decisions in humans. Nature (2006) 10.73

Empathic neural responses are modulated by the perceived fairness of others. Nature (2006) 6.04

Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacology (2010) 6.00

Lesions of dorsolateral striatum preserve outcome expectancy but disrupt habit formation in instrumental learning. Eur J Neurosci (2004) 5.62

States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron (2010) 5.30

The role of the dorsomedial striatum in instrumental conditioning. Eur J Neurosci (2005) 4.95

Temporal difference models describe higher-order learning in humans. Nature (2004) 4.94

The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans. J Neurosci (2006) 4.55

Reward, motivation, and reinforcement learning. Neuron (2002) 4.28

Double dissociation of basolateral and central amygdala lesions on the general and outcome-specific forms of pavlovian-instrumental transfer. J Neurosci (2005) 4.05

Regret and its avoidance: a neuroimaging study of choice behavior. Nat Neurosci (2005) 3.99

Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biol (2006) 3.80

Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. J Neurophysiol (2006) 3.53

Determining the neural substrates of goal-directed learning in the human brain. J Neurosci (2007) 3.31

Neural correlates of mentalizing-related computations during strategic interactions in humans. Proc Natl Acad Sci U S A (2008) 3.29

A specific role for posterior dorsolateral striatum in human habit learning. Eur J Neurosci (2009) 3.25

Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks. Eur J Neurosci (2008) 3.07

Opponent appetitive-aversive neural processes underlie predictive learning of pain relief. Nat Neurosci (2005) 3.05

Evidence for a common representation of decision values for dissimilar goods in human ventromedial prefrontal cortex. J Neurosci (2009) 3.02

Inactivation of dorsolateral striatum enhances sensitivity to changes in the action-outcome contingency in instrumental conditioning. Behav Brain Res (2005) 2.91

Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. J Neurosci (2007) 2.83

Neural evidence for inequality-averse social preferences. Nature (2010) 2.64

Orbitofrontal cortex mediates outcome encoding in Pavlovian but not instrumental conditioning. J Neurosci (2007) 2.61

The role of prelimbic cortex in instrumental conditioning. Behav Brain Res (2003) 2.51

Blockade of NMDA receptors in the dorsomedial striatum prevents action-outcome learning in instrumental conditioning. Eur J Neurosci (2005) 2.41

Determining a role for ventromedial prefrontal cortex in encoding action-based value signals during reward-related decision making. Cereb Cortex (2008) 2.40

Anxiety reduction through detachment: subjective, physiological, and neural effects. J Cogn Neurosci (2005) 2.32

Appetitive and aversive goal values are encoded in the medial orbitofrontal cortex at the time of decision making. J Neurosci (2010) 2.08

Amygdala central nucleus interacts with dorsolateral striatum to regulate the acquisition of habits. J Neurosci (2012) 2.00

Neural computations underlying action-based decision making in the human brain. Proc Natl Acad Sci U S A (2009) 1.98

The neural representation of unexpected uncertainty during value-based decision making. Neuron (2013) 1.95

Transformation of stimulus value signals into motor commands during simple choice. Proc Natl Acad Sci U S A (2011) 1.94

What we know and do not know about the functions of the orbitofrontal cortex after 20 years of cross-species studies. J Neurosci (2007) 1.93

Lesions of medial prefrontal cortex disrupt the acquisition but not the expression of goal-directed learning. J Neurosci (2005) 1.91

General and outcome-specific forms of Pavlovian-instrumental transfer: the effect of shifts in motivational state and inactivation of the ventral tegmental area. Eur J Neurosci (2007) 1.89

Contributions of the amygdala to reward expectancy and choice signals in human prefrontal cortex. Neuron (2007) 1.88

The decision value computations in the vmPFC and striatum use a relative value code that is guided by visual attention. J Neurosci (2011) 1.87

The general and outcome-specific forms of Pavlovian-instrumental transfer are differentially mediated by the nucleus accumbens core and shell. J Neurosci (2011) 1.74

Differential involvement of the basolateral amygdala and mediodorsal thalamus in instrumental action selection. J Neurosci (2008) 1.65

Differentiable contributions of human amygdalar subregions in the computations underlying reward and avoidance learning. Eur J Neurosci (2011) 1.64

Risk-dependent reward value signal in human prefrontal cortex. Proc Natl Acad Sci U S A (2009) 1.63

Overlapping responses for the expectation of juice and money rewards in human ventromedial prefrontal cortex. Cereb Cortex (2010) 1.59

The neural mechanisms underlying the influence of pavlovian cues on human decision making. J Neurosci (2008) 1.57

Instrumental and Pavlovian incentive processes have dissociable effects on components of a heterogeneous instrumental chain. J Exp Psychol Anim Behav Process (2003) 1.55

Habits, action sequences and reinforcement learning. Eur J Neurosci (2012) 1.54

Economic choices can be made using only stimulus values. Proc Natl Acad Sci U S A (2010) 1.51

Neural prediction errors reveal a risk-sensitive reinforcement-learning process in the human brain. J Neurosci (2012) 1.49

Lesions of mediodorsal thalamus and anterior thalamic nuclei produce dissociable effects on instrumental conditioning in rats. Eur J Neurosci (2003) 1.49

Consolidation and reconsolidation of incentive learning in the amygdala. J Neurosci (2005) 1.43

Contributions of the striatum to learning, motivation, and performance: an associative account. Trends Cogn Sci (2012) 1.42

At the limbic-motor interface: disconnection of basolateral amygdala from nucleus accumbens core and shell reveals dissociable components of incentive motivation. Eur J Neurosci (2010) 1.41

Differential dependence of Pavlovian incentive motivation and instrumental incentive learning processes on dopamine signaling. Learn Mem (2011) 1.36

Temporal isolation of neural processes underlying face preference decisions. Proc Natl Acad Sci U S A (2007) 1.31

Evidence of action sequence chunking in goal-directed instrumental conditioning and its dependence on the dorsomedial prefrontal cortex. J Neurosci (2009) 1.31

The contribution of orbitofrontal cortex to action selection. Ann N Y Acad Sci (2007) 1.30

Genetic control of instrumental conditioning by striatopallidal neuron-specific S1P receptor Gpr6. Nat Neurosci (2007) 1.30

Overlapping prediction errors in dorsal striatum during instrumental learning with juice and money reward in the human brain. J Neurophysiol (2009) 1.29

Binge-like consumption of a palatable food accelerates habitual control of behavior and is dependent on activation of the dorsolateral striatum. J Neurosci (2014) 1.29

On habits and addiction: An associative analysis of compulsive drug seeking. Drug Discov Today Dis Models (2008) 1.28

Direct instrumental conditioning of neural activity using functional magnetic resonance imaging-derived reward feedback. J Neurosci (2007) 1.27

Contingency awareness in human aversive conditioning involves the middle frontal gyrus. Neuroimage (2005) 1.25

Neuronal distortions of reward probability without choice. J Neurosci (2008) 1.22

Instrumental learning in hyperdopaminergic mice. Neurobiol Learn Mem (2006) 1.22

Actions, action sequences and habits: evidence that goal-directed and habitual action control are hierarchically organized. PLoS Comput Biol (2013) 1.22

Acquisition and performance of goal-directed instrumental actions depends on ERK signaling in distinct regions of dorsal striatum in rats. J Neurosci (2010) 1.22

Neural correlates of specific and general Pavlovian-to-Instrumental Transfer within human amygdalar subregions: a high-resolution fMRI study. J Neurosci (2012) 1.21

Selective impairment of prediction error signaling in human dorsolateral but not ventral striatum in Parkinson's disease patients: evidence from a model-based fMRI study. Neuroimage (2009) 1.21

Associative learning mechanisms underpinning the transition from recreational drug use to addiction. Ann N Y Acad Sci (2012) 1.20

Neural correlates of instrumental contingency learning: differential effects of action-reward conjunction and disjunction. J Neurosci (2011) 1.16

Human medial orbitofrontal cortex is recruited during experience of imagined and real rewards. J Neurophysiol (2010) 1.16

Category-dependent and category-independent goal-value codes in human ventromedial prefrontal cortex. Nat Neurosci (2013) 1.14

The thalamostriatal pathway and cholinergic control of goal-directed action: interlacing new with existing learning in the striatum. Neuron (2013) 1.14

Molecular substrates of action control in cortico-striatal circuits. Prog Neurobiol (2011) 1.12

Micro-opioid receptor activation in the basolateral amygdala mediates the learning of increases but not decreases in the incentive value of a food reward. J Neurosci (2011) 1.12

The influence of Pavlovian cues on instrumental performance is mediated by CaMKII activity in the striatum. Eur J Neurosci (2007) 1.10

In the mind of the market: theory of mind biases value computation during financial bubbles. Neuron (2013) 1.09

Extracellular dopamine levels in striatal subregions track shifts in motivation and response cost during instrumental conditioning. J Neurosci (2011) 1.09

Neural mechanisms underlying paradoxical performance for monetary incentives are driven by loss aversion. Neuron (2012) 1.05

Anterior prefrontal cortex contributes to action selection through tracking of recent reward trends. J Neurosci (2012) 1.05

Contributions of ERK signaling in the striatum to instrumental learning and performance. Behav Brain Res (2010) 1.03

Transient extracellular glutamate events in the basolateral amygdala track reward-seeking actions. J Neurosci (2012) 1.03

μ- and δ-opioid-related processes in the accumbens core and shell differentially mediate the influence of reward-guided and stimulus-guided decisions on choice. J Neurosci (2012) 1.01

Sensitivity to instrumental contingency degradation is mediated by the entorhinal cortex and its efferents via the dorsal hippocampus. J Neurosci (2002) 1.01

Incentive memory: evidence the basolateral amygdala encodes and the insular cortex retrieves outcome values to guide choice between goal-directed actions. J Neurosci (2013) 1.01

Striatal cholinergic interneurons display activity-related phosphorylation of ribosomal protein S6. PLoS One (2012) 0.98

Human dorsal striatum encodes prediction errors during observational learning of instrumental actions. J Cogn Neurosci (2011) 0.97

Alcohol-Paired Contextual Cues Produce an Immediate and Selective Loss of Goal-directed Action in Rats. Front Integr Neurosci (2010) 0.96

Stimulus salience and retrospective revaluation. J Exp Psychol Anim Behav Process (2006) 0.95

A neural basis for the effect of candidate appearance on election outcomes. Soc Cogn Affect Neurosci (2008) 0.95

Hierarchical and binary associations compete for behavioral control during instrumental biconditional discrimination. J Exp Psychol Anim Behav Process (2013) 0.93

Stimulus value signals in ventromedial PFC reflect the integration of attribute value signals computed in fusiform gyrus and posterior superior temporal gyrus. J Neurosci (2013) 0.92

The influence of amphetamine on sensory and conditioned reinforcement: evidence for the re-selection hypothesis of dopamine function. Front Integr Neurosci (2007) 0.91

Mediated conditioning versus retrospective revaluation in humans: the influence of physical and functional similarity of cues. Q J Exp Psychol (Hove) (2008) 0.91

Human dorsal striatal activity during choice discriminates reinforcement learning behavior from the gambler's fallacy. J Neurosci (2011) 0.91

Beyond simple reinforcement learning: the computational neurobiology of reward-learning and valuation. Eur J Neurosci (2012) 0.90

Reduced heart rate variability in social anxiety disorder: associations with gender and symptom severity. PLoS One (2013) 0.90

Dissociable brain systems mediate vicarious learning of stimulus-response and action-outcome contingencies. J Neurosci (2012) 0.90

The ventral striato-pallidal pathway mediates the effect of predictive learning on choice between goal-directed actions. J Neurosci (2013) 0.90