Does temporal discounting explain unhealthy behavior? A systematic review and reinforcement learning perspective.

PubWeight™: 1.34‹?› | Rank: Top 10%

🔗 View Article (PMC 3950931)

Published in Front Behav Neurosci on March 12, 2014

Authors

Giles W Story1, Ivo Vlaev2, Ben Seymour3, Ara Darzi2, Raymond J Dolan4

Author Affiliations

1: Department of Surgery and Cancer, Centre for Health Policy, Institute of Global Health Innovation, Imperial College London London, UK ; Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London London, UK.
2: Department of Surgery and Cancer, Centre for Health Policy, Institute of Global Health Innovation, Imperial College London London, UK.
3: Center for Information and Neural Networks, National Institute for Information and Communications Technology Tokyo, Japan.
4: Wellcome Trust Centre for Neuroimaging, Institute of Neurology, University College London London, UK.

Articles citing this

The genetics of impulsivity: evidence for the heritability of delay discounting. Biol Psychiatry (2014) 1.61

Optimal inference with suboptimal models: addiction and active Bayesian inference. Med Hypotheses (2014) 0.85

Thinking Forward: Future-oriented Thinking among Patients with Tobacco-associated Thoracic Diseases and Their Surrogates. Am J Respir Crit Care Med (2016) 0.81

News from the NIH: using an experimental medicine approach to facilitate translational research. Transl Behav Med (2015) 0.80

Time-discounting and tobacco smoking: a systematic review and network analysis. Int J Epidemiol (2016) 0.79

Dysbiotic drift: mental health, environmental grey space, and microbiota. J Physiol Anthropol (2015) 0.78

The role of time and risk preferences in adherence to physician advice on health behavior change. Eur J Health Econ (2016) 0.76

A Computational Analysis of Aberrant Delay Discounting in Psychiatric Disorders. Front Psychol (2016) 0.76

Computing reward-prediction error: an integrated account of cortical timing and basal-ganglia pathways for appetitive and aversive learning. Eur J Neurosci (2015) 0.76

Unhealthy diets, obesity and time discounting: a systematic literature review and network analysis. Obes Rev (2016) 0.76

Reasons for Child Passenger Nonrestraint in Motor Vehicles. Traffic Inj Prev (2015) 0.75

Integrating knowledge across domains to advance the science of health behavior: overcoming challenges and facilitating success. Transl Behav Med (2017) 0.75

Simplistic and complex thought in medicine: the rationale for a person-centered care model as a medical revolution. Patient Prefer Adherence (2016) 0.75

Patient education, nudge, and manipulation: defining the ethical conditions of the person-centered model of care. Patient Prefer Adherence (2016) 0.75

Neural correlates of eating disorders: translational potential. Neurosci Neuroecon (2015) 0.75

Simulating future value in intertemporal choice. Sci Rep (2017) 0.75

Anticipation and choice heuristics in the dynamic consumption of pain relief. PLoS Comput Biol (2015) 0.75

Observed and Normative Discount Functions in Addiction and other Diseases. Front Pharmacol (2017) 0.75

No Effect of Commercial Cognitive Training on Neural Activity During Decision-Making. J Neurosci (2017) 0.75

Articles cited by this

(truncated to the top 100)

Self-rated health and mortality: a review of twenty-seven community studies. J Health Soc Behav (1997) 39.72

Choice and delay of reinforcement. J Exp Anal Behav (1967) 19.80

Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat Neurosci (2005) 16.18

Separate neural systems value immediate and delayed monetary rewards. Science (2004) 13.85

Auto-maintenance in the pigeon: sustained pecking despite contingent non-reinforcement. J Exp Anal Behav (1969) 12.46

The preventable causes of death in the United States: comparative risk assessment of dietary, lifestyle, and metabolic risk factors. PLoS Med (2009) 12.13

Specious reward: a behavioral theory of impulsiveness and impulse control. Psychol Bull (1975) 11.27

Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci (2005) 9.16

A gradient of childhood self-control predicts health, wealth, and public safety. Proc Natl Acad Sci U S A (2011) 8.57

Heroin addicts have higher discount rates for delayed rewards than non-drug-using controls. J Exp Psychol Gen (1999) 8.30

Impulse control in pigeons. J Exp Anal Behav (1974) 7.81

Impulsivity and cigarette smoking: delay discounting in current, never, and ex-smokers. Psychopharmacology (Berl) (1999) 7.04

Measures of impulsivity in cigarette smokers and non-smokers. Psychopharmacology (Berl) (1999) 5.95

Impulsivity as a determinant and consequence of drug use: a review of underlying processes. Addict Biol (2008) 5.67

Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology (1999) 5.62

Impulsive and self-control choices in opioid-dependent patients and non-drug-using control participants: drug and monetary rewards. Exp Clin Psychopharmacol (1997) 5.32

States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron (2010) 5.30

Patients with hippocampal amnesia cannot imagine new experiences. Proc Natl Acad Sci U S A (2007) 5.15

Review. Neural mechanisms underlying the vulnerability to develop compulsive drug-seeking habits and addiction. Philos Trans R Soc Lond B Biol Sci (2008) 4.85

High impulsivity predicts the switch to compulsive cocaine-taking. Science (2008) 4.76

Time discounting for primary rewards. J Neurosci (2007) 4.76

Model-based influences on humans' choices and striatal prediction errors. Neuron (2011) 4.58

Tonic dopamine: opportunity costs and the control of response vigor. Psychopharmacology (Berl) (2006) 4.43

A review of delay-discounting research with humans: relations to drug use and gambling. Behav Pharmacol (2006) 4.41

Impulsivity and rapid discounting of delayed hypothetical rewards in cocaine-dependent individuals. Exp Clin Psychopharmacol (2003) 4.18

Hyperbolic temporal discounting in social drinkers and problem drinkers. Exp Clin Psychopharmacol (1998) 4.12

Remember the future: working memory training decreases delay discounting among stimulant addicts. Biol Psychiatry (2010) 3.92

Delay discounting of money and alcohol in actively using alcoholics, currently abstinent alcoholics, and controls. Psychopharmacology (Berl) (2001) 3.78

Delay discounting in current and never-before cigarette smokers: similarities and differences across commodity, sign, and magnitude. J Abnorm Psychol (2003) 3.76

Conditioning factors in drug abuse: can they explain compulsion? J Psychopharmacol (1998) 3.65

Behavioral impulsivity predicts treatment outcome in a smoking cessation program for adolescent smokers. Drug Alcohol Depend (2006) 3.61

Delayed reward discounting and addictive behavior: a meta-analysis. Psychopharmacology (Berl) (2011) 3.57

Excessive discounting of delayed rewards in substance abusers with gambling problems. Drug Alcohol Depend (1999) 3.56

Heroin and cocaine abusers have higher discount rates for delayed rewards than alcoholics or non-drug-using controls. Addiction (2004) 3.54

Episodic simulation of future events: concepts, data, and applications. Ann N Y Acad Sci (2008) 3.48

Dual-Process Theories of Higher Cognition: Advancing the Debate. Perspect Psychol Sci (2013) 3.41

Behavioral and neuroeconomics of drug addiction: competing neural systems and temporal discounting processes. Drug Alcohol Depend (2006) 3.26

A specific role for posterior dorsolateral striatum in human habit learning. Eur J Neurosci (2009) 3.25

Impulsivity in abstinent early- and late-onset alcoholics: differences in self-report measures and a discounting task. Addiction (2006) 3.24

Excessive discounting of delayed reinforcers as a trans-disease process contributing to addiction and other disease-related vulnerabilities: emerging evidence. Pharmacol Ther (2012) 2.98

Episodic future thinking reduces reward delay discounting through an enhancement of prefrontal-mediotemporal interactions. Neuron (2010) 2.85

Neurobiological substrates of dread. Science (2006) 2.83

Obese women show greater delay discounting than healthy-weight women. Appetite (2008) 2.78

Delay discounting predicts postpartum relapse to cigarette smoking among pregnant women. Exp Clin Psychopharmacol (2007) 2.77

Self-regulation and rapid weight gain in children from age 3 to 12 years. Arch Pediatr Adolesc Med (2009) 2.64

Ventral striatum and orbitofrontal cortex are both required for model-based, but not model-free, reinforcement learning. J Neurosci (2011) 2.55

Computational psychiatry. Trends Cogn Sci (2011) 2.40

Delay discounting and probability discounting as related to cigarette smoking status in adults. Behav Processes (2004) 2.38

Impulsive responding in alcoholics. Alcohol Clin Exp Res (2005) 2.36

Procrastination, deadlines, and performance: self-control by precommitment. Psychol Sci (2002) 2.33

Immediate reward bias in humans: fronto-parietal networks and a role for the catechol-O-methyltransferase 158(Val/Val) genotype. J Neurosci (2007) 2.33

Investigating the neurocognitive deficits associated with chronic drug misuse. Curr Opin Neurobiol (2001) 2.27

Alcohol demand, delayed reward discounting, and craving in relation to drinking and alcohol use disorders. J Abnorm Psychol (2010) 2.27

Mild opioid deprivation increases the degree that opioid-dependent outpatients discount delayed heroin and money. Psychopharmacology (Berl) (2002) 2.23

Delay discounting in currently using and currently abstinent cocaine-dependent outpatients and non-drug-using matched controls. Addict Behav (2005) 2.22

One-year temporal stability of delay-discount rates. Psychon Bull Rev (2009) 2.18

The misbehavior of value and the discipline of the will. Neural Netw (2006) 2.17

Temporal discounting and utility for health and money. J Exp Psychol Learn Mem Cogn (1996) 2.16

Does delay discounting play an etiological role in smoking or is it a consequence of smoking? Drug Alcohol Depend (2009) 2.15

Frontoparietal cortical activity of methamphetamine-dependent and comparison subjects performing a delay discounting task. Hum Brain Mapp (2007) 2.11

Neuropsychological function and delay discounting in methamphetamine-dependent individuals. Psychopharmacology (Berl) (2006) 2.09

Impulsivity in abstinent alcohol-dependent patients: relation to control subjects and type 1-/type 2-like traits. Alcohol (2005) 2.08

Goals and habits in the brain. Neuron (2013) 2.08

Discounting delayed and probabilistic monetary gains and losses by smokers of cigarettes. Psychopharmacology (Berl) (2005) 2.05

Healthy habits: efficacy of simple advice on weight control based on a habit-formation model. Int J Obes (Lond) (2007) 2.03

Delayed reward discounting predicts treatment response for heavy drinkers receiving smoking cessation treatment. Drug Alcohol Depend (2009) 2.01

Is a bird in the hand worth two in the future? The neuroeconomics of intertemporal decision-making. Prog Neurobiol (2007) 1.89

Needle sharing in opioid-dependent outpatients: psychological processes underlying risk. Drug Alcohol Depend (2000) 1.87

Integrating hippocampus and striatum in decision-making. Curr Opin Neurobiol (2008) 1.87

Time preference, time discounting, and smoking decisions. J Health Econ (2007) 1.85

Discounting of delayed health gains and losses by current, never- and ex-smokers of cigarettes. Nicotine Tob Res (2002) 1.85

Increased impulsivity in cocaine dependent subjects independent of antisocial personality disorder and aggression. Drug Alcohol Depend (2002) 1.83

Examining impulsivity as an endophenotype using a behavioral approach: a DRD2 TaqI A and DRD4 48-bp VNTR association study. Behav Brain Funct (2007) 1.83

Immediate pleasures and future consequences. A neuropsychological study of binge eating and obesity. Appetite (2009) 1.81

Delay and probability discounting as related to different stages of adolescent smoking and non-smoking. Behav Processes (2003) 1.78

Moderate drug use and delay discounting: a comparison of heavy, light, and never smokers. Exp Clin Psychopharmacol (2007) 1.77

Discounting and health benefits: another perspective. Health Econ (1992) 1.76

Delay discounting and the behavioural economics of cigarette purchases in smokers: the effects of nicotine deprivation. Psychopharmacology (Berl) (2006) 1.72

Time preference in medical decision making and cost-effectiveness analysis. Med Decis Making (1993) 1.69

Valuing the future: temporal discounting of health and money. Med Decis Making (1996) 1.68

Disinhibitory psychopathology and delay discounting in alcohol dependence: personality and cognitive correlates. Exp Clin Psychopharmacol (2009) 1.67

Delay discounting and the alcohol Stroop in heavy drinking adolescents. Addiction (2007) 1.65

The behavioral- and neuro-economic process of temporal discounting: A candidate behavioral marker of addiction. Neuropharmacology (2013) 1.65

Differences in impulsivity and risk-taking propensity between primary users of crack cocaine and primary users of heroin in a residential substance-use program. Exp Clin Psychopharmacol (2005) 1.61

Delay discounting: trait variable? Behav Processes (2011) 1.60

Temporal discounting and preference reversals in choice between delayed outcomes. Psychon Bull Rev (1994) 1.60

Delay discounting is associated with substance use in college students. Addict Behav (2003) 1.59

Ability to delay gratification at age 4 years and risk of overweight at age 11 years. Arch Pediatr Adolesc Med (2009) 1.59

Delay discounting predicts cigarette smoking in a laboratory model of abstinence reinforcement. Psychopharmacology (Berl) (2007) 1.55

Impulsivity in obese women. Appetite (2006) 1.53

Dopamine enhances model-based over model-free choice behavior. Neuron (2012) 1.53

Heritability of delay discounting in adolescence: a longitudinal twin study. Behav Genet (2010) 1.52

Delay discounting in current and former marijuana-dependent individuals. Exp Clin Psychopharmacol (2010) 1.48

Delay discounting, locus of control, and cognitive impulsiveness independently predict tobacco dependence treatment outcomes in a highly dependent, lower socioeconomic group of smokers. Am J Addict (2012) 1.45

Disruption of dorsolateral prefrontal cortex decreases model-based in favor of model-free control in humans. Neuron (2013) 1.45

An "as soon as possible" effect in human intertemporal decision making: behavioral evidence and neural mechanisms. J Neurophysiol (2010) 1.44

Predicting Hunger: The Effects of Appetite and Delay on Choice. Organ Behav Hum Decis Process (1998) 1.44

Comparison between two measures of delay discounting in smokers. Exp Clin Psychopharmacol (2003) 1.42

Multidimensional assessment of impulsivity in undergraduate hazardous drinkers and controls. J Stud Alcohol Drugs (2007) 1.41

Effects of short-term nicotine deprivation on decision-making: delay, uncertainty and effort discounting. Nicotine Tob Res (2004) 1.40