Reinforcement-based decision making in corticostriatal circuits: mutual constraints by neurocomputational and diffusion models.

PubWeight™: 1.44‹?› | Rank: Top 5%

🔗 View Article (PMID 22295983)

Published in Neural Comput on February 01, 2012

Authors

Roger Ratcliff1, Michael J Frank

Author Affiliations

1: Department of Psychology, The Ohio State University, Columbus, OH 43210, USA. ratcliff.22@osu.edu

Articles citing this

Neuronal activity in the human subthalamic nucleus encodes decision conflict during action selection. J Neurosci (2012) 1.73

Midline frontal cortex low-frequency activity drives subthalamic nucleus oscillations during conflict. J Neurosci (2014) 1.59

Nonspecific Inhibition of the Motor System during Response Preparation. J Neurosci (2015) 1.57

HDDM: Hierarchical Bayesian estimation of the Drift-Diffusion Model in Python. Front Neuroinform (2013) 1.51

Metacognition in human decision-making: confidence and error monitoring. Philos Trans R Soc Lond B Biol Sci (2012) 1.51

Cognitive control over learning: creating, clustering, and generalizing task-set structure. Psychol Rev (2013) 1.29

Neuronal Reward and Decision Signals: From Theories to Data. Physiol Rev (2015) 1.24

Building Bridges between Perceptual and Economic Decision-Making: Neural and Computational Mechanisms. Front Neurosci (2012) 1.09

Distinct roles of dopamine and subthalamic nucleus in learning and probabilistic decision making. Brain (2012) 1.07

fMRI and EEG predictors of dynamic decision parameters during human reinforcement learning. J Neurosci (2015) 1.05

Frontal theta overrides pavlovian learning biases. J Neurosci (2013) 1.02

Eye tracking and pupillometry are indicators of dissociable latent decision processes. J Exp Psychol Gen (2014) 1.01

Corticostriatal output gating during selection from working memory. Neuron (2014) 0.98

Diffusion Decision Model: Current Issues and History. Trends Cogn Sci (2016) 0.98

Parameter variability and distributional assumptions in the diffusion model. Psychol Rev (2012) 0.96

Role of the indirect pathway of the basal ganglia in perceptual decision making. J Neurosci (2015) 0.90

The diffusion model is not a deterministic growth model: comment on Jones and Dzhafarov (2014). Psychol Rev (2014) 0.88

The subthalamic nucleus, oscillations, and conflict. Mov Disord (2015) 0.87

Time-varying boundaries for diffusion models of decision making and response time. Front Psychol (2014) 0.85

Competing basal ganglia pathways determine the difference between stopping and deciding not to go. Elife (2015) 0.84

Unreliable evidence: 2 sources of uncertainty during perceptual choice. Cereb Cortex (2013) 0.83

Learning to maximize reward rate: a model based on semi-Markov decision processes. Front Neurosci (2014) 0.83

Dynamics of individual perceptual decisions. J Neurophysiol (2015) 0.82

Measuring psychometric functions with the diffusion model. J Exp Psychol Hum Percept Perform (2014) 0.82

Mouse models of neurodevelopmental disease of the basal ganglia and associated circuits. Curr Top Dev Biol (2014) 0.81

Humans optimize decision-making by delaying decision onset. PLoS One (2014) 0.81

A cholinergic feedback circuit to regulate striatal population uncertainty and optimize reinforcement learning. Elife (2015) 0.80

Decisions Made with Less Evidence Involve Higher Levels of Corticosubthalamic Nucleus Theta Band Synchrony. J Cogn Neurosci (2016) 0.80

A computational analysis of flanker interference in depression. Psychol Med (2015) 0.79

Taming the beast: extracting generalizable knowledge from computational models of cognition. Curr Opin Behav Sci (2016) 0.79

Comparing fixed and collapsing boundary versions of the diffusion model. J Math Psychol (2016) 0.78

Tamping Ramping: Algorithmic, Implementational, and Computational Explanations of Phasic Dopamine Signals in the Accumbens. PLoS Comput Biol (2015) 0.78

Ventral striatum and the evaluation of memory retrieval strategies. J Cogn Neurosci (2014) 0.78

Patients with Parkinson's Disease Show Impaired Use of Priors in Conditions of Sensory Uncertainty. Curr Biol (2016) 0.78

The drift diffusion model as the choice rule in reinforcement learning. Psychon Bull Rev (2016) 0.77

Local dynamics in decision making: The evolution of preference within and across decisions. Sci Rep (2013) 0.77

Human subthalamic nucleus-medial frontal cortex theta phase coherence is involved in conflict and error related cortical monitoring. Neuroimage (2016) 0.76

Dual reward prediction components yield Pavlovian sign- and goal-tracking. PLoS One (2014) 0.75

How cognitive theory guides neuroscience. Cognition (2014) 0.75

Intralaminar and tectal projections to the subthalamus in the rat. Eur J Neurosci (2016) 0.75

The importance of decision onset. J Neurophysiol (2015) 0.75

Distinct mechanisms mediate speed-accuracy adjustments in cortico-subthalamic networks. Elife (2017) 0.75

Acute Stimulant Treatment and Reinforcement Increase the Speed of Information Accumulation in Children with ADHD. J Abnorm Child Psychol (2016) 0.75

Articles by these authors

Triangulating a cognitive control network using diffusion-weighted magnetic resonance imaging (MRI) and functional MRI. J Neurosci (2007) 5.03

Making working memory work: a computational model of learning in the prefrontal cortex and basal ganglia. Neural Comput (2006) 3.59

Selective reinforcement learning deficits in schizophrenia support predictions from computational models of striatal-cortical dysfunction. Biol Psychiatry (2007) 2.98

Subthalamic nucleus stimulation reverses mediofrontal influence over decision threshold. Nat Neurosci (2011) 2.26

Striatal dopamine predicts outcome-specific reversal learning and its sensitivity to dopaminergic drug administration. J Neurosci (2009) 2.23

From reinforcement learning models to psychiatric and neurological disorders. Nat Neurosci (2011) 2.20

Towards an executive without a homunculus: computational models of the prefrontal cortex/basal ganglia system. Philos Trans R Soc Lond B Biol Sci (2007) 1.92

Frontal theta links prediction errors to behavioral adaptation in reinforcement learning. Neuroimage (2009) 1.86

Modeling response signal and response time data. Cogn Psychol (2006) 1.82

Negative symptoms of schizophrenia are associated with abnormal effort-cost computations. Biol Psychiatry (2013) 1.77

PVLV: the primary value and learned value Pavlovian learning algorithm. Behav Neurosci (2007) 1.75

Negative symptoms and the failure to represent the expected reward value of actions: behavioral and computational modeling evidence. Arch Gen Psychiatry (2012) 1.73

Neurocomputational models of basal ganglia function in learning, memory and choice. Behav Brain Res (2008) 1.71

Instructional control of reinforcement learning: a behavioral and neurocomputational investigation. Brain Res (2009) 1.65

Single dose of a dopamine agonist impairs reinforcement learning in humans: behavioral evidence from a laboratory-based measure of reward responsiveness. Psychopharmacology (Berl) (2007) 1.64

A computational model of inhibitory control in frontal cortex and basal ganglia. Psychol Rev (2013) 1.60

Dopaminergic genes predict individual differences in susceptibility to confirmation bias. J Neurosci (2011) 1.58

Deficits in positive reinforcement learning and uncertainty-driven exploration are associated with distinct aspects of negative symptoms in schizophrenia. Biol Psychiatry (2010) 1.58

Pupillometric and behavioral markers of a developmental shift in the temporal dynamics of cognitive control. Proc Natl Acad Sci U S A (2009) 1.55

HDDM: Hierarchical Bayesian estimation of the Drift-Diffusion Model in Python. Front Neuroinform (2013) 1.51

Rostrolateral prefrontal cortex and individual differences in uncertainty-driven exploration. Neuron (2012) 1.46

A role for dopamine in temporal decision making and reward maximization in parkinsonism. J Neurosci (2008) 1.42

Mechanisms of hierarchical reinforcement learning in cortico-striatal circuits 2: evidence from fMRI. Cereb Cortex (2011) 1.33

Patients with schizophrenia demonstrate inconsistent preference judgments for affective and nonaffective stimuli. Schizophr Bull (2010) 1.29

A dopaminergic basis for working memory, learning and attentional shifting in Parkinsonism. Neuropsychologia (2008) 1.29

Cognitive control over learning: creating, clustering, and generalizing task-set structure. Psychol Rev (2013) 1.29

Single dose of a dopamine agonist impairs reinforcement learning in humans: evidence from event-related potentials and computational modeling of striatal-cortical function. Hum Brain Mapp (2009) 1.25

Hippocampus, cortex, and basal ganglia: insights from computational models of complementary learning systems. Neurobiol Learn Mem (2004) 1.24

How much of reinforcement learning is working memory, not reinforcement learning? A behavioral, computational, and neurogenetic analysis. Eur J Neurosci (2012) 1.23

Effects of aging and IQ on item and associative memory. J Exp Psychol Gen (2011) 1.22

Altered probabilistic learning and response biases in schizophrenia: behavioral evidence and neurocomputational modeling. Neuropsychology (2011) 1.21

Seeing is believing: trustworthiness as a dynamic belief. Cogn Psychol (2010) 1.21

How preparation changes the need for top-down control of the basal ganglia when inhibiting premature actions. J Neurosci (2012) 1.14

Neural mechanisms of acquired phasic dopamine responses in learning. Neurosci Biobehav Rev (2009) 1.12

Frontal theta reflects uncertainty and unexpectedness during exploration and exploitation. Cereb Cortex (2011) 1.11

Social stress reactivity alters reward and punishment learning. Soc Cogn Affect Neurosci (2010) 1.10

Freezing of gait in Parkinson's disease is associated with functional decoupling between the cognitive control network and the basal ganglia. Brain (2013) 1.06

Neurocomputational models of motor and cognitive deficits in Parkinson's disease. Prog Brain Res (2010) 1.04

Frontal theta overrides pavlovian learning biases. J Neurosci (2013) 1.02

Task-related dissociation in ERN amplitude as a function of obsessive-compulsive symptoms. Neuropsychologia (2009) 1.00

Dissociable responses to punishment in distinct striatal regions during reversal learning. Neuroimage (2010) 1.00

Stress modulates reinforcement learning in younger and older adults. Psychol Aging (2012) 0.98

Probabilistic reinforcement learning in adults with autism spectrum disorders. Autism Res (2011) 0.96

Perceptual discrimination in static and dynamic noise: the temporal relation between perceptual encoding and decision making. J Exp Psychol Gen (2010) 0.94

A neurocomputational account of catalepsy sensitization induced by D2 receptor blockade in rats: context dependency, extinction, and renewal. Psychopharmacology (Berl) (2009) 0.93

Altered cingulate sub-region activation accounts for task-related dissociation in ERN amplitude as a function of obsessive-compulsive symptoms. Neuropsychologia (2010) 0.92

Larger Error Signals in Major Depression are Associated with Better Avoidance Learning. Front Psychol (2011) 0.91

Hypothetical decision making in schizophrenia: the role of expected value computation and "irrational" biases. Psychiatry Res (2013) 0.91

The role of frontostriatal impairment in freezing of gait in Parkinson's disease. Front Syst Neurosci (2013) 0.91

Pleasurable music affects reinforcement learning according to the listener. Front Psychol (2013) 0.90

A role for dopamine-mediated learning in the pathophysiology and treatment of Parkinson's disease. Cell Rep (2012) 0.88

Acute stress selectively reduces reward sensitivity. Front Hum Neurosci (2013) 0.88

Differential, but not opponent, effects of L -DOPA and citalopram on action learning with reward and punishment. Psychopharmacology (Berl) (2014) 0.88

The subthalamic nucleus contributes to post-error slowing. J Cogn Neurosci (2014) 0.87

CNTRICS imaging biomarkers final task selection: Long-term memory and reinforcement learning. Schizophr Bull (2011) 0.86

Reduced susceptibility to confirmation bias in schizophrenia. Cogn Affect Behav Neurosci (2014) 0.84

Reinforcement learning and higher level cognition: introduction to special issue. Cognition (2009) 0.83

Human EEG uncovers latent generalizable rule structure during learning. J Neurosci (2014) 0.83

Optimizing vs. matching: response strategy in a probabilistic learning task is associated with negative symptoms of schizophrenia. Schizophr Res (2011) 0.82

Dopaminergic basis for impairments in functional connectivity across subdivisions of the striatum in Parkinson's disease. Hum Brain Mapp (2014) 0.82

Feedback-driven trial-by-trial learning in autism spectrum disorders. Am J Psychiatry (2014) 0.81

Transitive inference in adults with autism spectrum disorders. Cogn Affect Behav Neurosci (2011) 0.81

Cognitive correlates of psychosis in patients with Parkinson's disease. Cogn Neuropsychiatry (2014) 0.79

Sensitivity to reward and punishment in major depressive disorder: effects of rumination and of single versus multiple experiences. Cogn Emot (2012) 0.78

Stop! Stay tuned for more information. Exp Neurol (2013) 0.77

Interrelations between cognitive dysfunction and motor symptoms of Parkinson's disease: behavioral and neural studies. Rev Neurosci (2016) 0.75