Bias in sensitivity and specificity caused by data-driven selection of optimal cutoff values: mechanisms, magnitude, and solutions.

PubWeight™: 1.58‹?› | Rank: Top 4%

🔗 View Article (PMID 18258670)

Published in Clin Chem on February 07, 2008

Authors

Mariska M G Leeflang1, Karel G M Moons, Johannes B Reitsma, Aielko H Zwinderman

Author Affiliations

1: Department of Clinical Epidemiology, Biostatistics and Bioinformatics, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands.

Articles citing this

Systematic reviews of diagnostic test accuracy. Ann Intern Med (2008) 4.84

Diagnosing norovirus-associated infectious intestinal disease using viral load. BMC Infect Dis (2009) 2.09

Therapeutic misconception in research subjects: development and validation of a measure. Clin Trials (2012) 1.92

Predictive accuracy of amyloid imaging for progression from mild cognitive impairment to Alzheimer disease with different lengths of follow-up: a meta-analysis. [Corrected]. Medicine (Baltimore) (2014) 1.50

Critical appraisal and data extraction for systematic reviews of prediction modelling studies: the CHARMS checklist. PLoS Med (2014) 1.35

Is calcaneal quantitative ultrasound useful as a prescreen stratification tool for osteoporosis? Osteoporos Int (2015) 1.20

A comparison of the accuracy of ultrasound and computed tomography in common diagnoses causing acute abdominal pain. Eur Radiol (2011) 1.12

Optical coherence tomography (OCT) for detection of macular oedema in patients with diabetic retinopathy. Cochrane Database Syst Rev (2015) 1.03

Individual patient data meta-analysis of diagnostic and prognostic studies in obstetrics, gynaecology and reproductive medicine. BMC Med Res Methodol (2009) 0.97

The diagnostic value of the FIB-4 index for staging hepatitis B-related fibrosis: a meta-analysis. PLoS One (2014) 0.90

Systematic Review and Meta-Analysis of Studies Evaluating Diagnostic Test Accuracy: A Practical Review for Clinical Researchers-Part I. General Guidance and Tips. Korean J Radiol (2015) 0.87

STARD 2015 guidelines for reporting diagnostic accuracy studies: explanation and elaboration. BMJ Open (2016) 0.87

Neuropsychological tests for the diagnosis of Alzheimer's disease dementia and other dementias: a generic protocol for cross-sectional and delayed-verification studies. Cochrane Database Syst Rev (2013) 0.86

Diagnostic Value of Presepsin for Sepsis: A Systematic Review and Meta-Analysis. Medicine (Baltimore) (2015) 0.83

Screening for Depression in the General Population with the Center for Epidemiologic Studies Depression (CES-D): A Systematic Review with Meta-Analysis. PLoS One (2016) 0.83

Acoustic radiation force impulse elastography for differentiation of malignant and benign breast lesions: a meta-analysis. Int J Clin Exp Med (2015) 0.83

Rapid-thrombelastography (r-TEG) thresholds for goal-directed resuscitation of patients at risk for massive transfusion. J Trauma Acute Care Surg (2016) 0.82

Meta-analysis of test accuracy studies: an exploratory method for investigating the impact of missing thresholds. Syst Rev (2015) 0.82

Sensitivity and Specificity Improvement in Abdominal Obesity Diagnosis Using Cluster Analysis during Waist Circumference Cut-Off Point Selection. J Diabetes Res (2015) 0.82

Variable selection for binary classification using error rate p-values applied to metabolomics data. BMC Bioinformatics (2016) 0.81

Clinimetrics corner: the many faces of selection bias. J Man Manip Ther (2010) 0.81

E-selectin and vascular cell adhesion molecule-1 as biomarkers of 3-month outcome in cerebrovascular diseases. J Inflamm (Lond) (2015) 0.81

Diagnostic Accuracy of Natriuretic Peptides for Heart Failure in Patients with Pleural Effusion: A Systematic Review and Updated Meta-Analysis. PLoS One (2015) 0.80

Colonization Density of the Upper Respiratory Tract as a Predictor of Pneumonia-Haemophilus influenzae, Moraxella catarrhalis, Staphylococcus aureus, and Pneumocystis jirovecii. Clin Infect Dis (2017) 0.78

Is Higher Viral Load in the Upper Respiratory Tract Associated With Severe Pneumonia? Findings From the PERCH Study. Clin Infect Dis (2017) 0.78

The diagnostic accuracy of serological tests for Lyme borreliosis in Europe: a systematic review and meta-analysis. BMC Infect Dis (2016) 0.77

Evidence synthesis to inform model-based cost-effectiveness evaluations of diagnostic tests: a methodological review of health technology assessments. BMC Med Res Methodol (2017) 0.75

Estimating the optimal threshold for a diagnostic biomarker in case of complex biomarker distributions. BMC Med Inform Decis Mak (2014) 0.75

Diagnosis of pulmonary hypertension from magnetic resonance imaging-based computational models and decision tree analysis. Pulm Circ (2016) 0.75

Association of C-Reactive Protein With Bacterial and Respiratory Syncytial Virus-Associated Pneumonia Among Children Aged <5 Years in the PERCH Study. Clin Infect Dis (2017) 0.75

Somatic Copy Number Alterations at Oncogenic Loci Show Diverse Correlations with Gene Expression. Sci Rep (2016) 0.75

Systematic Review of the Diagnostic Accuracy of Haptoglobin, Serum Amyloid A, and Fibrinogen versus Clinical Reference Standards for the Diagnosis of Bovine Respiratory Disease. J Vet Intern Med (2016) 0.75

Selective Cutoff Reporting in Studies of Diagnostic Test Accuracy: A Comparison of Conventional and Individual-Patient-Data Meta-Analyses of the Patient Health Questionnaire-9 Depression Screening Tool. Am J Epidemiol (2017) 0.75

MR spectroscopy of breast cancer for assessing early treatment response: Results from the ACRIN 6657 MRS trial. J Magn Reson Imaging (2016) 0.75

Evaluation of Pneumococcal Load in Blood by Polymerase Chain Reaction for the Diagnosis of Pneumococcal Pneumonia in Young Children in the PERCH Study. Clin Infect Dis (2017) 0.75

Diagnostic thresholds with three ordinal groups. J Biopharm Stat (2014) 0.75

Articles by these authors

The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Methodol (2003) 16.17

QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med (2011) 15.02

Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. BMJ (2003) 10.80

The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Ann Intern Med (2003) 10.28

Review: a gentle introduction to imputation of missing values. J Clin Epidemiol (2006) 8.87

Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD Initiative. Ann Intern Med (2003) 8.58

Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Standards for Reporting of Diagnostic Accuracy. Clin Chem (2003) 8.13

The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Clin Chem (2003) 7.92

Clinical features and prognostic factors in adults with bacterial meningitis. N Engl J Med (2004) 7.87

Sources of variation and bias in studies of diagnostic accuracy: a systematic review. Ann Intern Med (2004) 6.87

Prognosis and prognostic research: validating a prognostic model. BMJ (2009) 6.54

Polyp miss rate determined by tandem colonoscopy: a systematic review. Am J Gastroenterol (2006) 6.03

Effect of intracranial pressure monitoring and targeted intensive care on functional outcome after severe head injury. Crit Care Med (2005) 5.85

Expansion of the prognostic assessment of patients with chronic obstructive pulmonary disease: the updated BODE index and the ADO index. Lancet (2009) 5.51

Cognitive outcome after off-pump and on-pump coronary artery bypass graft surgery: a randomized trial. JAMA (2002) 5.06

Prognosis and prognostic research: Developing a prognostic model. BMJ (2009) 4.38

Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): the TRIPOD statement. Ann Intern Med (2015) 4.32

Evaluation of QUADAS, a tool for the quality assessment of diagnostic accuracy studies. BMC Med Res Methodol (2006) 3.78

Development and validation of MIX: comprehensive free software for meta-analysis of causal research data. BMC Med Res Methodol (2006) 3.67

Evidence of bias and variation in diagnostic accuracy studies. CMAJ (2006) 3.34

Comparison of on-demand vs planned relaparotomy strategy in patients with severe peritonitis: a randomized trial. JAMA (2007) 3.30

Imputation of missing values is superior to complete case analysis and the missing-indicator method in multivariable diagnostic research: a clinical example. J Clin Epidemiol (2006) 3.28

The Wells rule does not adequately rule out deep venous thrombosis in primary care patients. Ann Intern Med (2005) 3.21

Prognosis Research Strategy (PROGRESS) 3: prognostic model research. PLoS Med (2013) 3.13

Effectiveness of electronic fetal monitoring with additional ST analysis in vertex singleton pregnancies at >36 weeks of gestation: an individual participant data metaanalysis. Am J Obstet Gynecol (2013) 3.10

Dealing with missing outcome data in randomized trials and observational studies. Am J Epidemiol (2011) 3.03

Probabilistic record linkage is a valid and transparent tool to combine databases without a patient identification number. J Clin Epidemiol (2007) 3.00

Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Fam Pract (2004) 2.99

Immortal time bias in critical care research: application of time-varying Cox regression for observational cohort studies. Crit Care Med (2009) 2.96

Extended transthoracic resection compared with limited transhiatal resection for adenocarcinoma of the mid/distal esophagus: five-year survival of a randomized clinical trial. Ann Surg (2007) 2.78

Urine neutrophil gelatinase-associated lipocalin moderately predicts acute kidney injury in critically ill adults. J Am Soc Nephrol (2009) 2.77

Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD Initiative. Radiology (2003) 2.73

Prognostic factors in adenocarcinoma of the esophagus or gastroesophageal junction. J Clin Oncol (2006) 2.72

Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): explanation and elaboration. Ann Intern Med (2015) 2.71

Clinical features, complications, and outcome in adults with pneumococcal meningitis: a prospective case series. Lancet Neurol (2006) 2.67

Treatment of acute posttraumatic stress disorder with brief cognitive behavioral therapy: a randomized controlled trial. Am J Psychiatry (2007) 2.65

Clinical decision rules for excluding pulmonary embolism: a meta-analysis. Ann Intern Med (2011) 2.57

Meta-analysis of MR imaging in the diagnosis of breast lesions. Radiology (2007) 2.43

Safe exclusion of pulmonary embolism using the Wells rule and qualitative D-dimer testing in primary care: prospective cohort study. BMJ (2012) 2.38

Missing covariate data in medical research: to impute is better than to ignore. J Clin Epidemiol (2010) 2.37

Comparing the diagnostic performance of 2 clinical decision rules to rule out deep vein thrombosis in primary care patients. Ann Fam Med (2011) 2.34

Prognosis research strategy (PROGRESS) 1: a framework for researching clinical outcomes. BMJ (2013) 2.31

Incidence and predictors of short- and long-term complications in pacemaker therapy: the FOLLOWPACE study. Heart Rhythm (2011) 2.29

Internal and external validation of predictive models: a simulation study of bias and precision in small samples. J Clin Epidemiol (2003) 2.28

Reporting and methods in clinical prediction research: a systematic review. PLoS Med (2012) 2.26

Development and validation of a prediction model with missing predictor data: a practical approach. J Clin Epidemiol (2009) 2.24

Prognosis Research Strategy (PROGRESS) 2: prognostic factor research. PLoS Med (2013) 2.23

Prognostic significance of elevated cyclooxygenase 2 expression in patients with adenocarcinoma of the esophagus. Gastroenterology (2002) 2.19

Safely ruling out deep venous thrombosis in primary care. Ann Intern Med (2009) 2.16

The effect of outpatient preoperative evaluation of hospital inpatients on cancellation of surgery and length of hospital stay. Anesth Analg (2002) 2.16

Antecolic versus retrocolic route of the gastroenteric anastomosis after pancreatoduodenectomy: a randomized controlled trial. Ann Surg (2014) 2.15

Methotrexate versus cyclosporine in moderate-to-severe chronic plaque psoriasis. N Engl J Med (2003) 2.12

Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Clin Chem Lab Med (2003) 2.10

Cerebral hemodynamic responses to blood pressure manipulation in severely head-injured patients in the presence or absence of intracranial hypertension. Anesth Analg (2004) 2.10

Prevalence and triggers of syncope in medical students. Am J Cardiol (2003) 2.08

Cortisol and post-traumatic stress disorder in adults: systematic review and meta-analysis. Br J Psychiatry (2007) 2.06

Hybrid myocardial perfusion SPECT/CT coronary angiography and invasive coronary angiography in patients with stable angina pectoris lead to similar treatment decisions. Heart (2012) 2.05

Incidence of intraoperative hypotension as a function of the chosen definition: literature definitions applied to a retrospective cohort using automated data collection. Anesthesiology (2007) 2.05

Predictive factors for postherpetic neuralgia. Clin J Pain (2013) 2.03

External validity of risk models: Use of benchmark values to disentangle a case-mix effect from incorrect coefficients. Am J Epidemiol (2010) 2.03

Case-control and two-gate designs in diagnostic accuracy studies. Clin Chem (2005) 1.98

Accuracy of the Wells clinical prediction rule for pulmonary embolism in older ambulatory adults. J Am Geriatr Soc (2014) 1.98

Overinterpretation and misreporting of diagnostic accuracy studies: evidence of "spin". Radiology (2013) 1.96

The PINE study of epidural steroids and local anaesthetics to prevent postherpetic neuralgia: a randomised controlled trial. Lancet (2006) 1.95

Long-term functional outcome and risk factors for recurrence after surgical treatment for low and high perianal fistulas of cryptoglandular origin. Dis Colon Rectum (2008) 1.92

Childhood constipation: longitudinal follow-up beyond puberty. Gastroenterology (2003) 1.89

Short- and long-term prognosis after acute myocardial infarction in men versus women. Am J Cardiol (2006) 1.89

Galactomannan detection for invasive aspergillosis in immunocompromized patients. Cochrane Database Syst Rev (2008) 1.88

Diagnostic accuracy of conventional or age adjusted D-dimer cut-off values in older patients with suspected venous thromboembolism: systematic review and meta-analysis. BMJ (2013) 1.86

Intraoperative hypotension and 1-year mortality after noncardiac surgery. Anesthesiology (2009) 1.85

Improvements in risk stratification for the occurrence of cardiovascular disease by imaging subclinical atherosclerosis: a systematic review. Heart (2011) 1.80

Variables associated with positive findings at relaparotomy in patients with secondary peritonitis. Crit Care Med (2007) 1.80

Diagnostic accuracy of point-of-care fecal calprotectin and immunochemical occult blood tests for diagnosis of organic bowel disease in primary care: the Cost-Effectiveness of a Decision Rule for Abdominal Complaints in Primary Care (CEDAR) study. Clin Chem (2012) 1.79

Lifetime cumulative incidence of syncope in the general population: a study of 549 Dutch subjects aged 35-60 years. J Cardiovasc Electrophysiol (2006) 1.79

The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. The Standards for Reporting of Diagnostic Accuracy Group. Croat Med J (2003) 1.76

Limited value of patient history and physical examination in diagnosing deep vein thrombosis in primary care. Fam Pract (2005) 1.73

Prognosis research strategy (PROGRESS) 4: stratified medicine research. BMJ (2013) 1.71

Quality of reporting of diagnostic accuracy studies. Radiology (2005) 1.70

Fast-track anesthesia and cardiac surgery: a retrospective cohort study of 7989 patients. Anesth Analg (2009) 1.68

Cardiotocography plus ST analysis of fetal electrocardiogram compared with cardiotocography only for intrapartum monitoring: a randomized controlled trial. Obstet Gynecol (2010) 1.68

A risk score for unfavorable outcome in adults with bacterial meningitis. Ann Neurol (2008) 1.66

Value of history-taking in syncope patients: in whom to suspect long QT syndrome? Europace (2009) 1.65

Toward complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Acad Radiol (2003) 1.64

The diagnostic value of history and physical examination for COPD in suspected or known cases: a systematic review. Fam Pract (2009) 1.62

Preoperative prediction of the occurrence and severity of complications after esophagectomy for cancer with use of a nomogram. Ann Thorac Surg (2008) 1.60

Community-acquired bacterial meningitis in older people. J Am Geriatr Soc (2006) 1.59

Serum mesothelin for diagnosing malignant pleural mesothelioma: an individual patient data meta-analysis. J Clin Oncol (2012) 1.59

Should scoring rules be based on odds ratios or regression coefficients? J Clin Epidemiol (2002) 1.58

The STARD initiative. Lancet (2003) 1.57

Esophageal cancer: CT, endoscopic US, and FDG PET for assessment of response to neoadjuvant therapy--systematic review. Radiology (2005) 1.56

Gut-directed hypnotherapy for functional abdominal pain or irritable bowel syndrome in children: a systematic review. Arch Dis Child (2012) 1.54

Validation of two age dependent D-dimer cut-off values for exclusion of deep vein thrombosis in suspected elderly patients in primary care: retrospective, cross sectional, diagnostic analysis. BMJ (2012) 1.54

Observer variation in MRI evaluation of patients suspected of lumbar disk herniation. AJR Am J Roentgenol (2005) 1.54

Prediction models for risk of developing type 2 diabetes: systematic literature search and independent external validation study. BMJ (2012) 1.52

A systematic review finds that diagnostic reviews fail to incorporate quality despite available tools. J Clin Epidemiol (2005) 1.51

Beyond diagnostic accuracy: the clinical utility of diagnostic tests. Clin Chem (2012) 1.49