False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant.

PubWeight™: 13.65‹?› | Rank: Top 0.1% | All-Time Top 10000

🔗 View Article (PMID 22006061)

Published in Psychol Sci on October 17, 2011

Authors

Joseph P Simmons1, Leif D Nelson, Uri Simonsohn

Author Affiliations

1: Wharton School, University of Pennsylvania, Philadelphia, PA 19104, USA. jsimmo@wharton.upenn.edu

Associated clinical trials:

Effect of Coping With Stress Program to Depression, Anxiety, Brain Functions in Adolescent at High-Risk for Depression | NCT03779477

Articles citing this

(truncated to the top 100)

A call for transparent reporting to optimize the predictive value of preclinical research. Nature (2012) 14.63

Power failure: why small sample size undermines the reliability of neuroscience. Nat Rev Neurosci (2013) 13.37

Science faculty's subtle gender biases favor male students. Proc Natl Acad Sci U S A (2012) 12.93

Evaluating Amazon's Mechanical Turk as a tool for experimental behavioral research. PLoS One (2013) 4.05

SCIENTIFIC STANDARDS. Promoting an open research culture. Science (2015) 3.56

Deep impact: unintended consequences of journal rank. Front Hum Neurosci (2013) 2.78

How to make more published research true. PLoS Med (2014) 2.55

An open investigation of the reproducibility of cancer biology research. Elife (2014) 2.43

Top 10 Replicated Findings From Behavioral Genetics. Perspect Psychol Sci (2016) 2.36

US studies may overestimate effect sizes in softer research. Proc Natl Acad Sci U S A (2013) 2.06

Statistics: P values are just the tip of the iceberg. Nature (2015) 2.02

Replication studies: Bad copy. Nature (2012) 1.99

Pragmatic replication trial of health promotion coaching for obesity in serious mental illness and maintenance of outcomes. Am J Psychiatry (2014) 1.94

Threatening communication: a critical re-analysis and a revised meta-analytic test of fear appeal theory. Health Psychol Rev (2013) 1.87

Contextual sensitivity in scientific reproducibility. Proc Natl Acad Sci U S A (2016) 1.83

Modelling the effects of subjective and objective decision making in scientific peer review. Nature (2013) 1.73

The extent and consequences of p-hacking in science. PLoS Biol (2015) 1.71

Publication and other reporting biases in cognitive sciences: detection, prevalence, and prevention. Trends Cogn Sci (2014) 1.69

Why your new cancer biomarker may never work: recurrent patterns and remarkable diversity in biomarker failures. Cancer Res (2012) 1.69

Reproducibility in Psychological Science: When Do Psychological Phenomena Exist? Front Psychol (2017) 1.63

Is there an excess of significant findings in published studies of psychotherapy for depression? Psychol Med (2014) 1.60

Early diagnostic suggestions improve accuracy of GPs: a randomised controlled trial using computer-simulated patients. Br J Gen Pract (2015) 1.58

Common misconceptions about data analysis and statistics. Naunyn Schmiedebergs Arch Pharmacol (2014) 1.52

Practitioner review: A critical perspective on gene-environment interaction models--what impact should they have on clinical perceptions and practice? J Child Psychol Psychiatry (2014) 1.51

The Use and Abuse of Transcranial Magnetic Stimulation to Modulate Corticospinal Excitability in Humans. PLoS One (2015) 1.48

Publication bias and the limited strength model of self-control: has the evidence for ego depletion been overestimated? Front Psychol (2014) 1.48

Priming intelligent behavior: an elusive phenomenon. PLoS One (2013) 1.47

Ethnic diversity deflates price bubbles. Proc Natl Acad Sci U S A (2014) 1.47

Examining the Predictive Validity of NIH Peer Review Scores. PLoS One (2015) 1.45

A default Bayesian hypothesis test for correlations and partial correlations. Psychon Bull Rev (2012) 1.43

Using prediction markets to estimate the reproducibility of scientific research. Proc Natl Acad Sci U S A (2015) 1.37

Social science. Promoting transparency in social science research. Science (2014) 1.33

On the plurality of (methodological) worlds: estimating the analytic flexibility of FMRI experiments. Front Neurosci (2012) 1.31

Robust speech perception: recognize the familiar, generalize to the similar, and adapt to the novel. Psychol Rev (2015) 1.26

Publication bias in psychology: a diagnosis based on the correlation between effect size and sample size. PLoS One (2014) 1.23

College football, elections, and false-positive results in observational research. Proc Natl Acad Sci U S A (2015) 1.22

Statisticians issue warning over misuse of P values. Nature (2016) 1.20

Boring but important: a self-transcendent purpose for learning fosters academic self-regulation. J Pers Soc Psychol (2014) 1.19

Priming of social distance? Failure to replicate effects on social and food judgments. PLoS One (2012) 1.16

Candidate gene-environment interaction research: reflections and recommendations. Perspect Psychol Sci (2015) 1.16

The data detective. Interview by Ed Yong. Nature (2012) 1.15

Common misconceptions about data analysis and statistics. Br J Pharmacol (2014) 1.14

Replication, falsification, and the crisis of confidence in social psychology. Front Psychol (2015) 1.14

Improving basic and translational science by accounting for litter-to-litter variation in animal models. BMC Neurosci (2013) 1.12

Prenatal maternal stress and atopic diseases in the child: a systematic review of observational human studies. Allergy (2015) 1.11

The academic, economic and societal impacts of Open Access: an evidence-based review. F1000Res (2016) 1.11

Evidence that publication bias contaminated studies relating social class and unethical behavior. Proc Natl Acad Sci U S A (2012) 1.11

Retrieval interference in reflexive processing: experimental evidence from Mandarin, and computational modeling. Front Psychol (2015) 1.08

Exploring the relationship between negative urgency and dysregulated eating: etiologic associations and the role of negative affect. J Abnorm Psychol (2013) 1.08

Characterizing the time-perspective of nations with search engine query data. PLoS One (2014) 1.08

A common neural code for perceived and inferred emotion. J Neurosci (2014) 1.08

Working Memory Training Does Not Improve Performance on Measures of Intelligence or Other Measures of "Far Transfer": Evidence From a Meta-Analytic Review. Perspect Psychol Sci (2016) 1.07

p-Curve and p-Hacking in Observational Research. PLoS One (2016) 1.03

Considerations in the assessment of heart rate variability in biobehavioral research. Front Psychol (2014) 1.03

Biparental incubation patterns in a high-Arctic breeding shorebird: how do pairs divide their duties? Behav Ecol (2013) 1.02

Facial emotion expression recognition by children at familial risk for depression: high-risk boys are oversensitive to sadness. J Child Psychol Psychiatry (2012) 1.02

A surge of p-values between 0.041 and 0.049 in recent decades (but negative results are increasing rapidly too). PeerJ (2015) 1.02

A Large Scale Test of the Effect of Social Class on Prosocial Behavior. PLoS One (2015) 1.02

On the persistence of low power in psychological science. Q J Exp Psychol (Hove) (2014) 1.01

Scanning the horizon: towards transparent and reproducible neuroimaging research. Nat Rev Neurosci (2017) 1.01

Statistical inferences under the Null hypothesis: common mistakes and pitfalls in neuroimaging studies. Front Neurosci (2015) 1.01

Common scientific and statistical errors in obesity research. Obesity (Silver Spring) (2016) 0.99

Teasing apart retrieval and encoding interference in the processing of anaphors. Front Psychol (2015) 0.99

Underpowered samples, false negatives, and unconscious learning. Psychon Bull Rev (2016) 0.99

The N-pact factor: evaluating the quality of empirical journals with respect to sample size and statistical power. PLoS One (2014) 0.98

Low levels of empathic concern predict utilitarian moral judgment. PLoS One (2013) 0.98

Statistical and Methodological Considerations for the Interpretation of Intranasal Oxytocin Studies. Biol Psychiatry (2015) 0.98

Excess success for psychology articles in the journal science. PLoS One (2014) 0.98

Divergent effects of beliefs in heaven and hell on national crime rates. PLoS One (2012) 0.98

Encourage Playing with Data and Discourage Questionable Reporting Practices. Psychometrika (2016) 0.98

Why selective publication of statistically significant results can be effective. PLoS One (2013) 0.97

Correlates of cognitive change. J Exp Psychol Gen (2013) 0.97

Project INTEGRATE: An integrative study of brief alcohol interventions for college students. Psychol Addict Behav (2014) 0.95

Predicting the unpredictable: critical analysis and practical implications of predictive anticipatory activity. Front Hum Neurosci (2014) 0.95

Two failures to replicate high-performance-goal priming effects. PLoS One (2013) 0.95

After a pair of self-control-intensive tasks, sucrose swishing improves subsequent working memory performance. BMC Psychol (2013) 0.94

The perspectival shift: how experiments on unconscious processing don't justify the claims made for them. Front Psychol (2014) 0.94

The natural selection of bad science. R Soc Open Sci (2016) 0.93

The search for human pheromones: the lost decades and the necessity of returning to first principles. Proc Biol Sci (2015) 0.92

Outlier removal and the relation with reporting errors and quality of psychological research. PLoS One (2014) 0.92

Do motivations for using Facebook moderate the association between Facebook use and psychological well-being? Front Psychol (2015) 0.92

Building a Science of Individual Differences from fMRI. Trends Cogn Sci (2016) 0.91

Using Design Thinking to Improve Psychological Interventions: The Case of the Growth Mindset During the Transition to High School. J Educ Psychol (2016) 0.91

No band color effects on male courtship rate or body mass in the zebra finch: four experiments and a meta-analysis. PLoS One (2012) 0.91

Seven Pervasive Statistical Flaws in Cognitive Training Interventions. Front Hum Neurosci (2016) 0.91

No Evidence of the Ego-Depletion Effect across Task Characteristics and Individual Differences: A Pre-Registered Study. PLoS One (2016) 0.90

Using cannabis to help you sleep: heightened frequency of medical cannabis use among those with PTSD. Drug Alcohol Depend (2013) 0.90

Are Associations Between "Sexist" Video Games and Decreased Empathy Toward Women Robust? A Reanalysis of Gabbiadini et al. 2016. J Youth Adolesc (2017) 0.90

A comment on Farwell (2012): brain fingerprinting: a comprehensive tutorial review of detection of concealed information with event-related brain potentials. Cogn Neurodyn (2012) 0.89

The methodological quality of animal research in critical care: the public face of science. Ann Intensive Care (2014) 0.89

Making sense of replications. Elife (2017) 0.88

The emergence of sex differences in risk for disordered eating attitudes during puberty: a role for prenatal testosterone exposure. J Abnorm Psychol (2013) 0.88

Molecular-genetic correlates of infant attachment: a cautionary tale. Attach Hum Dev (2013) 0.88

Distributions of p-values smaller than .05 in psychology: what is going on? PeerJ (2016) 0.87

Why publishing everything is more effective than selective publishing of statistically significant results. PLoS One (2014) 0.87

Significance chasing in research practice: causes, consequences and possible solutions. Addiction (2014) 0.87

Registered reports: a new submission format at Drug and Alcohol Dependence. Drug Alcohol Depend (2014) 0.87

Replication, Communication, and the Population Dynamics of Scientific Discovery. PLoS One (2015) 0.87

The Search for Significance: A Few Peculiarities in the Distribution of P Values in Experimental Psychology Literature. PLoS One (2015) 0.87

Conducting Meta-Analyses Based on p Values: Reservations and Recommendations for Applying p-Uniform and p-Curve. Perspect Psychol Sci (2016) 0.86