Dynamic response-by-response models of matching behavior in rhesus monkeys.

PubWeight™: 3.83‹?› | Rank: Top 1%

🔗 View Article (PMC 1389781)

Published in J Exp Anal Behav on November 01, 2005

Authors

Brian Lau1, Paul W Glimcher

Author Affiliations

1: Center for Neural Science, New York University, New York, New York 10003, USA. brian.lau@nyu.edu

Articles citing this

(truncated to the top 100)

Model-based influences on humans' choices and striatal prediction errors. Neuron (2011) 4.58

Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron (2010) 3.28

Decision making in recurrent neuronal circuits. Neuron (2008) 3.19

Value representations in the primate striatum during matching behavior. Neuron (2008) 3.02

Temporal filtering of reward signals in the dorsal anterior cingulate cortex during a mixed-strategy game. J Neurosci (2007) 2.92

The role of human orbitofrontal cortex in value comparison for incommensurable objects. J Neurosci (2009) 2.51

Linear-Nonlinear-Poisson models of primate choice dynamics. J Exp Anal Behav (2005) 2.49

Value-based modulations in human visual cortex. Neuron (2008) 2.35

Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis. Proc Natl Acad Sci U S A (2011) 2.33

Surprise signals in anterior cingulate cortex: neuronal encoding of unsigned reward prediction errors driving adjustment in behavior. J Neurosci (2011) 2.06

Distinct roles of rodent orbitofrontal and medial prefrontal cortex in decision making. Neuron (2010) 1.99

Integration of sensory and reward information during perceptual decision-making in lateral intraparietal cortex (LIP) of the macaque monkey. PLoS One (2010) 1.94

Transient stimulation of distinct subpopulations of striatal neurons mimics changes in action value. Nat Neurosci (2012) 1.79

Reciprocal relations between cognitive neuroscience and formal cognitive models: opposites attract? Trends Cogn Sci (2011) 1.73

Dopaminergic drugs modulate learning rates and perseveration in Parkinson's patients in a dynamic foraging task. J Neurosci (2009) 1.72

Decision making as a window on cognition. Neuron (2013) 1.67

A reservoir of time constants for memory traces in cortical neurons. Nat Neurosci (2011) 1.66

Human reinforcement learning subdivides structured action spaces by learning effector-specific values. J Neurosci (2009) 1.66

Reinforcement learning in multidimensional environments relies on attention mechanisms. J Neurosci (2015) 1.65

Instructional control of reinforcement learning: a behavioral and neurocomputational investigation. Brain Res (2009) 1.65

Disentangling the roles of approach, activation and valence in instrumental and pavlovian responding. PLoS Comput Biol (2011) 1.63

Cortical signals for rewarded actions and strategic exploration. Neuron (2013) 1.59

A computational framework for the study of confidence in humans and animals. Philos Trans R Soc Lond B Biol Sci (2012) 1.58

Serotonin selectively modulates reward value in human decision-making. J Neurosci (2012) 1.49

Rostrolateral prefrontal cortex and individual differences in uncertainty-driven exploration. Neuron (2012) 1.46

Undesirable Choice Biases with Small Differences in the Spatial Structure of Chance Stimulus Sequences. PLoS One (2015) 1.38

Adaptive decision making and value in the anterior cingulate cortex. Neuroimage (2007) 1.36

Bayesian online learning of the hazard rate in change-point problems. Neural Comput (2010) 1.33

Role of rodent secondary motor cortex in value-based action selection. Nat Neurosci (2011) 1.29

Operant matching is a generic outcome of synaptic plasticity based on the covariance between reward and neural activity. Proc Natl Acad Sci U S A (2006) 1.29

Signals in human striatum are appropriate for policy update rather than value prediction. J Neurosci (2011) 1.29

Mesolimbic dopamine signals the value of work. Nat Neurosci (2015) 1.27

Actions, action sequences and habits: evidence that goal-directed and habitual action control are hierarchically organized. PLoS Comput Biol (2013) 1.22

Dissociating hippocampal and striatal contributions to sequential prediction learning. Eur J Neurosci (2012) 1.19

Integrated Bayesian models of learning and decision making for saccadic eye movements. Neural Netw (2008) 1.19

Tonic dopamine modulates exploitation of reward learning. Front Behav Neurosci (2010) 1.17

Contextual factors explain risk-seeking preferences in rhesus monkeys. Front Neurosci (2013) 1.16

Interplay of approximate planning strategies. Proc Natl Acad Sci U S A (2015) 1.14

Of goals and habits: age-related and individual differences in goal-directed decision-making. Front Neurosci (2013) 1.13

The relative influences of priors and sensory evidence on an oculomotor decision variable during perceptual learning. J Neurophysiol (2008) 1.12

Population response profiles in early visual cortex are biased in favor of more valuable stimuli. J Neurophysiol (2010) 1.11

Ongoing behavior predicts perceptual report of interval duration. Front Neurorobot (2014) 1.11

Differentiable neural substrates for learned and described value and risk. Curr Biol (2010) 1.09

Generalization of value in reinforcement learning by humans. Eur J Neurosci (2012) 1.07

Anterior prefrontal cortex contributes to action selection through tracking of recent reward trends. J Neurosci (2012) 1.05

Adaptive criterion setting in perceptual decision making. J Exp Anal Behav (2011) 1.04

Learning where to look for a hidden target. Proc Natl Acad Sci U S A (2013) 1.01

On surprise, change, and the effect of recent outcomes. Front Psychol (2012) 1.00

Dynamic estimation of task-relevant variance in movement under risk. J Neurosci (2012) 0.97

Devaluation and sequential decisions: linking goal-directed and model-based behavior. Front Hum Neurosci (2014) 0.95

Choice as a function of reinforcer "hold": from probability learning to concurrent reinforcement. J Exp Psychol Anim Behav Process (2008) 0.94

Model-based analyses: Promises, pitfalls, and example applications to the study of cognitive control. Q J Exp Psychol (Hove) (2011) 0.93

Naming our concerns about neuroscience: a review of Bennett and Hacker's philosophical foundations of neuroscience. J Exp Anal Behav (2005) 0.93

Attention stabilizes the shared gain of V4 populations. Elife (2015) 0.92

Variability in Dopamine Genes Dissociates Model-Based and Model-Free Reinforcement Learning. J Neurosci (2016) 0.91

Modeling the violation of reward maximization and invariance in reinforcement schedules. PLoS Comput Biol (2008) 0.91

Dopaminergic Balance between Reward Maximization and Policy Complexity. Front Syst Neurosci (2011) 0.91

Decomposing the roles of perseveration and expected value representation in models of the Iowa gambling task. Front Psychol (2013) 0.89

Robustness of learning that is based on covariance-driven synaptic plasticity. PLoS Comput Biol (2008) 0.89

Reward and choice encoding in terminals of midbrain dopamine neurons depends on striatal target. Nat Neurosci (2016) 0.89

Effects of emotion on prospection during decision-making. Front Psychol (2014) 0.88

Differential, but not opponent, effects of L -DOPA and citalopram on action learning with reward and punishment. Psychopharmacology (Berl) (2014) 0.88

Explicit melioration by a neural diffusion model. Brain Res (2009) 0.87

Competition for visual selection in the oculomotor system. J Neurosci (2011) 0.87

The Relationship between Saccadic Choice and Reaction Times with Manipulations of Target Value. Front Neurosci (2011) 0.86

Adaptable history biases in human perceptual decisions. Proc Natl Acad Sci U S A (2016) 0.85

Role of dopamine D2 receptors in optimizing choice strategy in a dynamic and uncertain environment. Front Behav Neurosci (2014) 0.85

Orbitofrontal dopamine depletion upregulates caudate dopamine and alters behavior via changes in reinforcement sensitivity. J Neurosci (2014) 0.85

Modeling the value of strategic actions in the superior colliculus. Front Behav Neurosci (2010) 0.85

The matching relation and situation-specific bias modulation in professional football play selection. J Exp Anal Behav (2010) 0.85

Barycentric extension of generalized matching. J Exp Anal Behav (2009) 0.85

State-based versus reward-based motivation in younger and older adults. Cogn Affect Behav Neurosci (2014) 0.84

The effects of the previous outcome on probabilistic choice in rats. J Exp Psychol Anim Behav Process (2012) 0.84

Information: theory, brain, and behavior. J Exp Anal Behav (2013) 0.83

Episodic memory encoding interferes with reward learning and decreases striatal prediction errors. J Neurosci (2014) 0.83

Signal detection in animal psychoacoustics: analysis and simulation of sensory and decision-related influences. Neuroscience (2012) 0.83

A healthy fear of the unknown: perspectives on the interpretation of parameter fits from computational models in neuroscience. PLoS Comput Biol (2013) 0.82

Stimulus similarity determines the prevalence of behavioral laterality in a visual discrimination task for mice. Sci Rep (2014) 0.82

Decision-making based on emotional images. Front Psychol (2011) 0.81

Action-value comparisons in the dorsolateral prefrontal cortex control choice between goal-directed actions. Nat Commun (2014) 0.80

Taming the beast: extracting generalizable knowledge from computational models of cognition. Curr Opin Behav Sci (2016) 0.79

Ratio and difference comparisons of expected reward in decision-making tasks. Mem Cognit (2008) 0.79

Older Adults are Highly Responsive to Recent Events During Decision-Making. Decisions (2015) 0.79

Deep brain stimulation of the subthalamic nucleus modulates sensitivity to decision outcome value in Parkinson's disease. Sci Rep (2016) 0.79

A basal ganglia circuit for evaluating action outcomes. Nature (2016) 0.79

Modulation of neural activity by reward in medial intraparietal cortex is sensitive to temporal sequence of reward. J Neurophysiol (2014) 0.78

Stochastic matching and the voluntary nature of choice. J Exp Anal Behav (2007) 0.78

Damage to the Ventromedial Prefrontal Cortex Impairs Learning from Observed Outcomes. Cereb Cortex (2015) 0.78

Thorndike's Law 2.0: Dopamine and the Regulation of Thrift. Front Neurosci (2012) 0.78

Pigeons (Columba livia) approach Nash equilibrium in experimental Matching Pennies competitions. J Exp Anal Behav (2009) 0.78

Temporal trade-offs in psychophysics. Curr Opin Neurobiol (2016) 0.77

Bursts and heavy tails in temporal and sequential dynamics of foraging decisions. PLoS Comput Biol (2014) 0.77

Editorial: choice studies in transition. J Exp Anal Behav (2010) 0.77

Action selection in multi-effector decision making. Neuroimage (2012) 0.77

Effort, success, and nonuse determine arm choice. J Neurophysiol (2015) 0.77

Mechanisms of Individual Differences in Impulsive and Risky Choice in Rats. Comp Cogn Behav Rev (2015) 0.77

Inferring reward prediction errors in patients with schizophrenia: a dynamic reward task for reinforcement learning. Front Psychol (2014) 0.77

Hysteresis as an implicit prior in tactile spatial decision making. PLoS One (2014) 0.77

Posterior parietal cortex guides visual decisions in rats. J Neurosci (2017) 0.76

Effects of fictive reward on rat's choice behavior. Sci Rep (2015) 0.76

Articles cited by this

Relative and absolute strength of response as a function of frequency of reinforcement. J Exp Anal Behav (1961) 101.16

On two types of deviation from the matching law: bias and undermatching. J Exp Anal Behav (1974) 28.87

Choice as time allocation. J Exp Anal Behav (1969) 27.67

Predictive reward signal of dopamine neurons. J Neurophysiol (1998) 15.02

Probabilistically reinforced choice behavior in pigeons. J Exp Anal Behav (1966) 14.11

Matching, undermatching, and overmatching in studies of choice. J Exp Anal Behav (1979) 12.41

Effects of reinforcement magnitude on choice and rate of responding. J Exp Anal Behav (1967) 12.21

Dissociable roles of ventral and dorsal striatum in instrumental conditioning. Science (2004) 11.67

Neural correlates of decision variables in parietal cortex. Nature (1999) 10.33

Matching behavior and the representation of value in the parietal cortex. Science (2004) 9.83

Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. J Neurophysiol (2001) 9.51

Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. J Neurosci (2002) 9.41

Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron (2005) 7.56

Implantation of magnetic search coils for measurement of eye position: an improved method. Vision Res (1980) 6.80

Interval reinforcement of choice behavior in discrete trials. J Exp Anal Behav (1969) 5.89

Cognitive control signals for neural prosthetics. Science (2004) 5.37

Neural economics and the biological substrates of valuation. Neuron (2002) 5.37

Prefrontal cortex and decision making in a mixed-strategy game. Nat Neurosci (2004) 5.27

Activity in posterior parietal cortex is correlated with the relative subjective desirability of action. Neuron (2004) 4.60

Concurrent schedules of response-independent reinforcement: duration of a reinforcing stimulus. J Exp Anal Behav (1971) 4.45

Interaction of frequency and magnitude of reinforcement on concurrent performances. J Exp Anal Behav (1973) 4.27

Reinforcer effectiveness as a function of reinforcer rate and magnitude: a comparison of concurrent performances. J Exp Anal Behav (1973) 3.99

Choice in a variable environment: every reinforcer counts. J Exp Anal Behav (2000) 3.41

Parallel neural networks for learning sequential procedures. Trends Neurosci (1999) 3.35

A Markov model description of changeover probabilities on concurrent variable-interval schedules. J Exp Anal Behav (1979) 2.91

Saccade reward signals in posterior cingulate cortex. Neuron (2003) 2.83

Hill-climbing by pigeons. J Exp Anal Behav (1983) 2.70

Neural coding of basic reward terms of animal learning theory, game theory, microeconomics and behavioural ecology. Curr Opin Neurobiol (2004) 2.51

The process of recurrent choice. Psychol Rev (1993) 2.50

The rat approximates an ideal detector of changes in rates of reward: implications for the law of effect. J Exp Psychol Anim Behav Process (2001) 2.38

Parietal activity and the perceived direction of ambiguous apparent motion. Nat Neurosci (2003) 2.25

Operant variability: evidence, functions, and theory. Psychon Bull Rev (2002) 2.24

How to maximize reward rate on two variable-interval paradigms. J Exp Anal Behav (1981) 2.19

Duration and rate of reinforcement as determinants of concurrent responding. J Exp Anal Behav (1977) 2.08

Sequential organization of multiple movements: involvement of cortical motor areas. Annu Rev Neurosci (2001) 2.08

Dynamics in the fine structure of schedule-controlled behavior. J Exp Anal Behav (1992) 2.08

Concurrent schedules: undermatching and control by previous experimental conditions. J Exp Anal Behav (1979) 2.00

Optimal choice. J Exp Anal Behav (1981) 1.93

A neural correlate of reward-based behavioral learning in caudate nucleus: a functional magnetic resonance imaging study of a stochastic decision task. J Neurosci (2004) 1.88

Responses of intraparietal neurons to saccadic targets and visual distractors. J Neurophysiol (1997) 1.84

Choice in a variable environment: effects of blackout duration and extinction between components. J Exp Anal Behav (2002) 1.80

Determination of a behavioral transfer function: White-noise analysis of session-to-session response-ratio dynamics on concurrent VI VI schedules. J Exp Anal Behav (1985) 1.79

Concurrent performances: reinforcement by different doses of intravenous cocaine in rhesus monkeys. J Exp Anal Behav (1974) 1.78

Choice, contingency discrimination, and foraging theory. J Exp Anal Behav (1999) 1.73

Choice behavior in transition: development of preference for the higher probability of reinforcement. J Exp Anal Behav (1990) 1.69

Reinforcement learning and decision making in monkeys during a competitive game. Brain Res Cogn Brain Res (2004) 1.63

Choice behavior in transition: development of preference with ratio and interval schedules. J Exp Psychol Anim Behav Process (1992) 1.61

Every reinforcer counts: reinforcer magnitude and local preference. J Exp Anal Behav (2003) 1.60

Indeterminacy in brain and behavior. Annu Rev Psychol (2005) 1.44

Behavioral planning in the prefrontal cortex. Curr Opin Neurobiol (2001) 1.18

Experience-Weighted Attraction Learning in Coordination Games: Probability Rules, Heterogeneity, and Time-Variation. J Math Psychol (1998) 1.18

Kinetics of matching. J Exp Psychol Anim Behav Process (1994) 1.17

Investigating Behavioral Dynamics With A Fixed-time Extinction Schedule And Linear Analysis. J Exp Anal Behav (1996) 1.15

Rapid acquisition of preference in concurrent chains. J Exp Anal Behav (2003) 1.13

The generalized matching law as a predictor of choice between cocaine and food in rhesus monkeys. Psychopharmacology (Berl) (2002) 1.13

Learning variable and stereotypical sequences of responses: Some data and a new model. Behav Processes (1993) 1.11

Decisions, decisions, decisions: choosing a biological science of choice. Neuron (2002) 1.02

Linear modeling of steady-state behavioral dynamics. J Exp Anal Behav (2002) 1.00

Applying linear systems analysis to dynamic behavior. J Exp Anal Behav (1992) 0.98

Dynamical concurrent schedules. J Exp Anal Behav (2003) 0.97

Interresponse times and the structure of choice. Behav Processes (2004) 0.92

Articles by these authors

The neural correlates of subjective value during intertemporal choice. Nat Neurosci (2007) 9.46

Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron (2005) 7.56

The neurobiology of decision: consensus and controversy. Neuron (2009) 4.77

Activity in posterior parietal cortex is correlated with the relative subjective desirability of action. Neuron (2004) 4.60

Value representations in the primate striatum during matching behavior. Neuron (2008) 3.02

The root of all value: a neural common currency for choice. Curr Opin Neurobiol (2012) 2.71

Comparing apples and oranges: using reward-specific and reward-general subjective value representation in the brain. J Neurosci (2011) 2.55

Neural representation of subjective value under risk and ambiguity. J Neurophysiol (2009) 2.42

Action and outcome encoding in the primate caudate nucleus. J Neurosci (2007) 2.14

Phasic dopamine release in the rat nucleus accumbens symmetrically encodes a reward prediction error term. J Neurosci (2014) 2.14

Separating value from choice: delay discounting activity in the lateral intraparietal area. J Neurosci (2010) 1.93

Statistics of midbrain dopamine neuron spike trains in the awake primate. J Neurophysiol (2007) 1.85

Reward value-based gain control: divisive normalization in parietal cortex. J Neurosci (2011) 1.85

Dopaminergic drugs modulate learning rates and perseveration in Parkinson's patients in a dynamic foraging task. J Neurosci (2009) 1.72

Sustained activity in topographic areas of human posterior parietal cortex during memory-guided saccades. J Neurosci (2006) 1.52

Adolescents' risk-taking behavior is driven by tolerance to ambiguity. Proc Natl Acad Sci U S A (2012) 1.46

An "as soon as possible" effect in human intertemporal decision making: behavioral evidence and neural mechanisms. J Neurophysiol (2010) 1.44

Choice from non-choice: predicting consumer preferences from blood oxygenation level-dependent signals obtained during passive viewing. J Neurosci (2011) 1.39

Specificity of human cortical areas for reaches and saccades. J Neurosci (2007) 1.35

Like cognitive function, decision making across the life span shows profound age-related changes. Proc Natl Acad Sci U S A (2013) 1.27

Testing the reward prediction error hypothesis with an axiomatic model. J Neurosci (2010) 1.27

State dependent valuation: the effect of deprivation on risk preferences. PLoS One (2013) 1.23

Normalization is a general neural mechanism for context-dependent decision making. Proc Natl Acad Sci U S A (2013) 1.18

Comment on "In monkeys making value-based decisions, LIP neurons encode cue salience and not action value". Science (2013) 1.18

Thirst-dependent risk preferences in monkeys identify a primitive form of wealth. Proc Natl Acad Sci U S A (2013) 1.17

Efficient coding and the neural representation of value. Ann N Y Acad Sci (2012) 1.11

Visual processing, learning and feedback in the primate eye movement system. Trends Neurosci (2009) 0.89

Controlled water intake: a method for objectively evaluating thirst and hydration state in monkeys by the measurement of blood osmolality. J Neurosci Methods (2010) 0.86

Measuring the subjective value of risky and ambiguous options using experimental economics and functional MRI methods. J Vis Exp (2012) 0.85

An expected utility maximizer walks into a bar… J Risk Uncertain (2013) 0.83

Eye position and memory saccade related responses in substantia nigra pars reticulata. Exp Brain Res (2004) 0.82

Cognitive neuroscience and the law. Curr Opin Neurobiol (2006) 0.81

Rethinking the thalamus. Nat Neurosci (2005) 0.78