Striatal activity underlies novelty-based choice in humans.

PubWeight™: 1.92‹?› | Rank: Top 3%

🔗 View Article (PMC 2535823)

Published in Neuron on June 26, 2008

Authors

Bianca C Wittmann1, Nathaniel D Daw, Ben Seymour, Raymond J Dolan

Author Affiliations

1: Wellcome Trust Centre for Neuroimaging, University College London, 12 Queen Square, London WC1N3BG, UK. b.wittmann@ucl.ac.uk

Articles citing this

Model-based influences on humans' choices and striatal prediction errors. Neuron (2011) 4.58

Integrating memories in the human brain: hippocampal-midbrain encoding of overlapping events. Neuron (2008) 3.25

Striatal prediction error modulates cortical coupling. J Neurosci (2010) 2.31

Reward-learning and the novelty-seeking personality: a between- and within-subjects study of the effects of dopamine agonists on young Parkinson's patients. Brain (2009) 2.04

Sleep deprivation amplifies reactivity of brain reward networks, biasing the appraisal of positive emotional experiences. J Neurosci (2011) 1.58

Neurons in posterior cingulate cortex signal exploratory decisions in a dynamic multioption choice task. Curr Biol (2009) 1.46

Attention, learning, and the value of information. Neuron (2012) 1.45

Neural correlates of forward planning in a spatial decision task in humans. J Neurosci (2011) 1.43

Contributions of the striatum to learning, motivation, and performance: an associative account. Trends Cogn Sci (2012) 1.42

Neural activity associated with the passive prediction of ambiguity and risk for aversive events. J Neurosci (2009) 1.37

Alterations in choice behavior by manipulations of world model. Proc Natl Acad Sci U S A (2010) 1.29

Striatal contributions to declarative memory retrieval. Neuron (2012) 1.27

Testing the reward prediction error hypothesis with an axiomatic model. J Neurosci (2010) 1.27

Distinction between Externally vs. Internally Guided Decision-Making: Operational Differences, Meta-Analytical Comparisons and Their Theoretical Implications. Front Neurosci (2012) 1.24

Computational and dynamic models in neuroimaging. Neuroimage (2009) 1.21

Contextual novelty changes reward representations in the striatum. J Neurosci (2010) 1.20

Dissociating hippocampal and striatal contributions to sequential prediction learning. Eur J Neurosci (2012) 1.19

Neural mechanisms of acquired phasic dopamine responses in learning. Neurosci Biobehav Rev (2009) 1.12

Striatal responses to negative monetary outcomes differ between temperamentally inhibited and non-inhibited adolescents. Neuropsychologia (2010) 1.08

Functional brain networks associated with cognitive control, cocaine dependence, and treatment outcome. Psychol Addict Behav (2012) 1.08

Generalization of value in reinforcement learning by humans. Eur J Neurosci (2012) 1.07

Contextual interaction between novelty and reward processing within the mesolimbic system. Hum Brain Mapp (2011) 1.07

Is our self nothing but reward? Neuronal overlap and distinction between reward and personal relevance and its relation to human personality. PLoS One (2009) 1.06

Cerebellar and prefrontal cortex contributions to adaptation, strategies, and reinforcement learning. Prog Brain Res (2014) 1.05

Cortical and hippocampal correlates of deliberation during model-based decisions for rewards in humans. PLoS Comput Biol (2013) 0.95

Novelty enhances visual salience independently of reward in the parietal lobe. J Neurosci (2014) 0.93

Novelty or surprise? Front Psychol (2013) 0.93

Striatal and hippocampal entropy and recognition signals in category learning: simultaneous processes revealed by model-based fMRI. J Exp Psychol Learn Mem Cogn (2012) 0.93

Motor Planning under Unpredictable Reward: Modulations of Movement Vigor and Primate Striatum Activity. Front Neurosci (2011) 0.93

Uncertainty about mapping future actions into rewards may underlie performance on multiple measures of impulsivity in behavioral addiction: evidence from Parkinson's disease. Behav Neurosci (2013) 0.92

Altruistic learning. Front Behav Neurosci (2009) 0.91

Neural mechanisms underlying the induction and relief of perceptual curiosity. Front Behav Neurosci (2012) 0.89

Positive outcomes enhance incidental learning for both younger and older adults. Front Neurosci (2011) 0.89

Reinforcement learning models and their neural correlates: An activation likelihood estimation meta-analysis. Cogn Affect Behav Neurosci (2015) 0.88

The Psychology and Neuroscience of Curiosity. Neuron (2015) 0.88

Impulsivity and apathy in Parkinson's disease. J Neuropsychol (2013) 0.87

On the value of information and other rewards. Nat Neurosci (2011) 0.87

Novelty seeking behaviour in Parkinson's disease. Neuropsychologia (2011) 0.86

Theory of choice in bandit, information sampling and foraging tasks. PLoS Comput Biol (2015) 0.85

Interaction between emotional state and learning underlies mood instability. Nat Commun (2015) 0.85

Effects of inflammation on hippocampus and substantia nigra responses to novelty in healthy human participants. Neuropsychopharmacology (2014) 0.84

Cognitive flexibility in adolescence: neural and behavioral mechanisms of reward prediction error processing in adaptive decision making during development. Neuroimage (2014) 0.84

Active inference and learning. Neurosci Biobehav Rev (2016) 0.83

Neural correlates of the perception for novel objects. PLoS One (2013) 0.82

Impulsive and compulsive behaviors in Parkinson's disease. Annu Rev Clin Psychol (2013) 0.82

Striatal topography of probability and magnitude information for decisions under uncertainty. Neuroimage (2011) 0.81

Which is the best intrinsic motivation signal for learning multiple skills? Front Neurorobot (2013) 0.81

Neural correlates of dynamically evolving interpersonal ties predict prosocial behavior. Front Neurosci (2012) 0.81

Inferring brain-computational mechanisms with models of activity measurements. Philos Trans R Soc Lond B Biol Sci (2016) 0.81

Novelty and Inductive Generalization in Human Reinforcement Learning. Top Cogn Sci (2015) 0.79

Neural correlates of sequence learning with stochastic feedback. J Cogn Neurosci (2010) 0.79

Model-based action planning involves cortico-cerebellar and basal ganglia networks. Sci Rep (2016) 0.78

The effect of visual salience on memory-based choices. J Neurophysiol (2013) 0.78

Novelty encoding by the output neurons of the Basal Ganglia. Front Syst Neurosci (2010) 0.78

Novelty seeking is related to individual risk preference and brain activation associated with risk prediction during decision making. Sci Rep (2015) 0.78

Hemispheric Lateralization of Resting-State Functional Connectivity of the Anterior Insula: Association with Age, Gender, and a Novelty-Seeking Trait. Brain Connect (2016) 0.76

What to Choose Next? A Paradigm for Testing Human Sequential Decision Making. Front Psychol (2017) 0.75

Stimulus Novelty Energizes Actions in the Absence of Explicit Reward. PLoS One (2016) 0.75

Early exposure to dynamic environments alters patterns of motor exploration throughout the lifespan. Behav Brain Res (2016) 0.75

Reward and Novelty Enhance Imagination of Future Events in a Motivational-Episodic Network. PLoS One (2015) 0.75

The Role of Social Novelty in Risk Seeking and Exploratory Behavior: Implications for Addictions. PLoS One (2016) 0.75

Articles cited by this

Predictive reward signal of dopamine neurons. J Neurophysiol (1998) 15.02

Cortical substrates for exploratory decisions in humans. Nature (2006) 10.73

Temporal difference models and reward-related learning in the human brain. Neuron (2003) 8.50

Event-related fMRI: characterizing differential responses. Neuroimage (1998) 8.30

A new one-trial test for neurobiological studies of memory in rats. 1: Behavioral data. Behav Brain Res (1988) 7.29

Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature (2006) 6.90

Temporal prediction errors in a passive learning task activate human striatum. Neuron (2003) 6.44

Neuronal coding of prediction errors. Annu Rev Neurosci (2000) 5.91

Representation of action-specific reward values in the striatum. Science (2005) 5.76

Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops. Nat Neurosci (2004) 5.54

FMRI visualization of brain activity during a monetary incentive delay task. Neuroimage (2000) 5.15

Image distortion correction in fMRI: A quantitative evaluation. Neuroimage (2002) 4.64

Modeling geometric deformations in EPI time series. Neuroimage (2001) 4.55

Functional magnetic resonance imaging of reward prediction. Curr Opin Neurol (2005) 4.53

Midbrain dopamine neurons encode decisions for future action. Nat Neurosci (2006) 4.39

Reward, motivation, and reinforcement learning. Neuron (2002) 4.28

Mesolimbocortical and nigrostriatal dopamine responses to salient non-reward events. Neuroscience (2000) 3.95

Predictability modulates human brain response to reward. J Neurosci (2001) 3.81

Reward-related responses in the human striatum. Ann N Y Acad Sci (2007) 3.72

Reward-related FMRI activation of dopaminergic midbrain is associated with enhanced hippocampus-dependent long-term memory formation. Neuron (2005) 3.67

Absolute coding of stimulus novelty in the human substantia nigra/VTA. Neuron (2006) 3.32

Dissociable systems for gain- and loss-related value predictions and errors of prediction in the human brain. J Neurosci (2006) 3.30

The Tridimensional Personality Questionnaire: U.S. normative data. Psychol Rep (1991) 3.06

Activity in human ventral striatum locked to errors of reward prediction. Nat Neurosci (2002) 2.92

Pathological gambling is linked to reduced activation of the mesolimbic reward system. Nat Neurosci (2005) 2.90

Metalearning and neuromodulation. Neural Netw (2002) 2.77

Dopamine: generalization and bonuses. Neural Netw (2002) 2.75

Neuroeconomics: cross-currents in research on decision-making. Trends Cogn Sci (2006) 2.71

Human midbrain sensitivity to cognitive feedback and uncertainty during classification learning. J Neurophysiol (2004) 2.41

Gene-gene interaction associated with neural reward sensitivity. Proc Natl Acad Sci U S A (2007) 2.02

Anticipation of novelty recruits reward system and hippocampus while promoting recollection. Neuroimage (2007) 1.58

Burst activity of ventral tegmental dopamine neurons is elicited by sensory stimuli in the awake cat. Brain Res (1997) 1.53

Human neural learning depends on reward prediction errors in the blocking paradigm. J Neurophysiol (2005) 1.46

Ventral-striatal/nucleus-accumbens sensitivity to prediction errors during classification learning. Hum Brain Mapp (2006) 1.37

Policy adjustment in a dynamic economic game. PLoS One (2006) 1.24

Neotic preferences in laboratory rodents: issues, assessment and substrates. Neurosci Biobehav Rev (2007) 1.17

Regulation of attention to novel stimuli by frontal lobes: an event-related potential study. Neuroreport (1998) 1.17

Differentiation of idiopathic Parkinson's disease, multiple system atrophy, progressive supranuclear palsy, and healthy controls using magnetization transfer imaging. Neuroimage (2004) 1.15

Genetic susceptibility to substance dependence. Mol Psychiatry (2005) 1.14

The neural circuitry of reward and its relevance to psychiatric disorders. Curr Psychiatry Rep (2004) 1.07

Evolutionary mismatch, neural reward circuits, and pathological gambling. Int J Neurosci (2003) 0.86

In vivo basal ganglia volumetry through application of NURBS models to MR images. Neuroradiology (2006) 0.82

Articles by these authors

Neural systems supporting interoceptive awareness. Nat Neurosci (2004) 11.88

Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science (2004) 11.67

Empathy for pain involves the affective but not sensory components of pain. Science (2004) 11.33

Cortical substrates for exploratory decisions in humans. Nature (2006) 10.73

Temporal difference models and reward-related learning in the human brain. Neuron (2003) 8.50

Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature (2006) 6.90

Encoding predictive reward value in human amygdala and orbitofrontal cortex. Science (2003) 6.76

Frames, biases, and rational decision-making in the human brain. Science (2006) 6.67

Neural responses during anticipation of a primary taste reward. Neuron (2002) 6.40

Empathic neural responses are modulated by the perceived fairness of others. Nature (2006) 6.04

Human cingulate cortex and autonomic control: converging neuroimaging and clinical evidence. Brain (2003) 5.48

Temporal difference models describe higher-order learning in humans. Nature (2004) 4.94

Distant influences of amygdala lesion on visual cortical activation during emotional face processing. Nat Neurosci (2004) 4.72

Model-based influences on humans' choices and striatal prediction errors. Neuron (2011) 4.58

Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl) (2006) 4.43

Dissociating valence of outcome from behavioral control in human orbital and ventral prefrontal cortices. J Neurosci (2003) 4.21

Regret and its avoidance: a neuroimaging study of choice behavior. Nat Neurosci (2005) 3.99

Distinct spatial frequency sensitivities for processing faces and emotional expressions. Nat Neurosci (2003) 3.90

When fear is near: threat imminence elicits prefrontal-periaqueductal gray shifts in humans. Science (2007) 3.78

Relating introspective accuracy to individual differences in brain structure. Science (2010) 3.68

Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. J Neurophysiol (2006) 3.53

Context-dependent human extinction memory is mediated by a ventromedial prefrontal and hippocampal network. J Neurosci (2006) 3.17

Morphing Marilyn into Maggie dissociates physical and identity face representations in the brain. Nat Neurosci (2004) 3.12

The importance of mixed selectivity in complex cognitive tasks. Nature (2013) 3.05

Reinforcement learning signals in the human striatum distinguish learners from nonlearners during reward-based decision making. J Neurosci (2007) 2.83

Bayesian theories of conditioning in a changing world. Trends Cogn Sci (2006) 2.81

Predictive neural coding of reward preference involves dissociable responses in human ventral midbrain and ventral striatum. Neuron (2006) 2.72

Appetitive and aversive olfactory learning in humans studied using event-related functional magnetic resonance imaging. J Neurosci (2002) 2.65

Brain responses to the acquired moral status of faces. Neuron (2004) 2.61

Decision theory, reinforcement learning, and the brain. Cogn Affect Behav Neurosci (2008) 2.58

Subliminal instrumental conditioning demonstrated in the human brain. Neuron (2008) 2.55

The role of human orbitofrontal cortex in value comparison for incommensurable objects. J Neurosci (2009) 2.51

Brain activity underlying encoding and retrieval of source memory. Cereb Cortex (2002) 2.48

Anterior cingulate activity during error and autonomic response. Neuroimage (2005) 2.47

Oxytocin attenuates affective evaluations of conditioned faces and amygdala activity. J Neurosci (2008) 2.41

Computational psychiatry. Trends Cogn Sci (2011) 2.40

The neural basis of mood-congruent processing biases in depression. Arch Gen Psychiatry (2002) 2.35

Anxiety reduction through detachment: subjective, physiological, and neural effects. J Cogn Neurosci (2005) 2.32

Neural correlates of value, risk, and risk aversion contributing to decision making under risk. J Neurosci (2009) 2.29

Human orbitofrontal cortex mediates extinction learning while accessing conditioned representations of value. Nat Neurosci (2004) 2.25

A computational substrate for incentive salience. Trends Neurosci (2003) 2.24

Fear conditioning in humans: the influence of awareness and autonomic arousal on functional neuroanatomy. Neuron (2002) 2.22

An agent independent axis for executed and modeled choice in medial prefrontal cortex. Neuron (2012) 2.21

Attentional load and sensory competition in human vision: modulation of fMRI responses by load at fixation during task-irrelevant stimulation in the peripheral visual field. Cereb Cortex (2004) 2.19

Neural mechanisms of belief inference during cooperative games. J Neurosci (2010) 2.18

The misbehavior of value and the discipline of the will. Neural Netw (2006) 2.17

How humans integrate the prospects of pain and reward during choice. J Neurosci (2009) 2.14

How choice reveals and shapes expected hedonic outcome. J Neurosci (2009) 2.12

Brain systems for assessing facial attractiveness. Neuropsychologia (2006) 2.09

Mapping value based planning and extensively trained choice in the human brain. Nat Neurosci (2012) 2.09

Threatening a rubber hand that you feel is yours elicits a cortical anxiety response. Proc Natl Acad Sci U S A (2007) 2.08

Encoding of emotional memories depends on amygdala and hippocampus and their interactions. Nat Neurosci (2004) 2.08

Human pavlovian-instrumental transfer. J Neurosci (2008) 2.06

Task and content modulate amygdala-hippocampal connectivity in emotional retrieval. Neuron (2006) 2.05

Confidence in value-based choice. Nat Neurosci (2012) 2.00

Dopamine restores reward prediction errors in old age. Nat Neurosci (2013) 2.00

The neural basis of metacognitive ability. Philos Trans R Soc Lond B Biol Sci (2012) 1.99

Remembrance of odors past: human olfactory cortex in cross-modal recognition memory. Neuron (2004) 1.97

How the opinion of others affects our valuation of objects. Curr Biol (2010) 1.94

How unrealistic optimism is maintained in the face of reality. Nat Neurosci (2011) 1.94

From threat to fear: the neural organization of defensive fear systems in humans. J Neurosci (2009) 1.94

Serotonin and dopamine: unifying affective, activational, and decision functions. Neuropsychopharmacology (2010) 1.87

Time-series analysis for rapid event-related skin conductance responses. J Neurosci Methods (2009) 1.87

Genetic association and brain morphology studies and the chromosome 8p22 pericentriolar material 1 (PCM1) gene in susceptibility to schizophrenia. Arch Gen Psychiatry (2006) 1.86

Mechanisms underlying dopamine-mediated reward bias in compulsive behaviors. Neuron (2010) 1.85

Information theory, novelty and hippocampal responses: unpredicted or unpredictable? Neural Netw (2005) 1.82

Neural correlates of self-distraction from anxiety and a process model of cognitive emotion regulation. J Cogn Neurosci (2006) 1.82

A dual role for prediction error in associative learning. Cereb Cortex (2008) 1.78

Brain, emotion and decision making: the paradigmatic example of regret. Trends Cogn Sci (2007) 1.77

Following the crowd: brain substrates of long-term memory conformity. Science (2011) 1.74

Encoding of marginal utility across time in the human brain. J Neurosci (2009) 1.74

Preserved verbal memory function in left medial temporal pathology involves reorganisation of function to right medial temporal lobe. Neuroimage (2003) 1.73

Activity in the human brain predicting differential heart rate responses to emotional facial expressions. Neuroimage (2004) 1.71

Differential roles of human striatum and amygdala in associative learning. Nat Neurosci (2011) 1.71

The nose smells what the eye sees: crossmodal visual facilitation of human olfactory perception. Neuron (2003) 1.70

Go and no-go learning in reward and punishment: interactions between affect and effect. Neuroimage (2012) 1.69

Action dominates valence in anticipatory representations in the human striatum and dopaminergic midbrain. J Neurosci (2011) 1.68

The curse of planning: dissecting multiple reinforcement-learning systems by taxing the central executive. Psychol Sci (2013) 1.68

Integrated neural representations of odor intensity and affective valence in human amygdala. J Neurosci (2005) 1.67

A key role for similarity in vicarious reward. Science (2009) 1.67

Human reinforcement learning subdivides structured action spaces by learning effector-specific values. J Neurosci (2009) 1.66

The anatomy of choice: active inference and agency. Front Hum Neurosci (2013) 1.66

Modulation of spatial attention by fear-conditioned stimuli: an event-related fMRI study. Neuropsychologia (2002) 1.65

Knowing how much you don't know: a neural organization of uncertainty estimates. Nat Rev Neurosci (2012) 1.65