Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond.

PubWeight™: 57.29‹?› | Rank: Top 0.01% | All-Time Top 1000

🔗 View Article (PMID 17569110)

Published in Stat Med on January 30, 2008

Authors

Michael J Pencina1, Ralph B D'Agostino, Ralph B D'Agostino, Ramachandran S Vasan

Author Affiliations

1: Department of Mathematics and Statistics, Framingham Heart Study, Boston University, Boston, MA 02215, USA. mpencina@bu.edu

Articles citing this

(truncated to the top 100)

Estimating glomerular filtration rate from serum creatinine and cystatin C. N Engl J Med (2012) 14.99

Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers. Stat Med (2010) 14.49

Assessing the performance of prediction models: a framework for traditional and novel measures. Epidemiology (2010) 14.07

Cholesterol efflux capacity, high-density lipoprotein function, and atherosclerosis. N Engl J Med (2011) 13.55

Glycated hemoglobin, diabetes, and cardiovascular risk in nondiabetic adults. N Engl J Med (2010) 13.25

C-reactive protein concentration and risk of coronary heart disease, stroke, and mortality: an individual participant meta-analysis. Lancet (2009) 11.81

2013 ACC/AHA guideline on the assessment of cardiovascular risk: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. Circulation (2013) 10.24

Genotype score in addition to common risk factors for prediction of type 2 diabetes. N Engl J Med (2008) 9.68

Arterial stiffness and cardiovascular events: the Framingham Heart Study. Circulation (2010) 9.09

Separate and combined associations of body-mass index and abdominal adiposity with cardiovascular disease: collaborative analysis of 58 prospective studies. Lancet (2011) 9.07

Coronary artery calcium score and risk classification for coronary heart disease prediction. JAMA (2010) 8.90

2013 ACC/AHA guideline on the assessment of cardiovascular risk: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. J Am Coll Cardiol (2013) 8.90

HDL cholesterol efflux capacity and incident cardiovascular events. N Engl J Med (2014) 8.61

Criteria for evaluation of novel markers of cardiovascular risk: a scientific statement from the American Heart Association. Circulation (2009) 8.11

Cystatin C versus creatinine in determining risk based on kidney function. N Engl J Med (2013) 7.98

Advances in measuring the effect of individual predictors of cardiovascular risk: the role of reclassification measures. Ann Intern Med (2009) 7.62

C-reactive protein and parental history improve global cardiovascular risk prediction: the Reynolds Risk Score for men. Circulation (2008) 7.33

Development of a risk score for atrial fibrillation (Framingham Heart Study): a community-based cohort study. Lancet (2009) 7.27

Hyponatremia and mortality among patients on the liver-transplant waiting list. N Engl J Med (2008) 6.67

C-reactive protein, fibrinogen, and cardiovascular disease prediction. N Engl J Med (2012) 6.39

Comparison of risk prediction using the CKD-EPI equation and the MDRD study equation for estimated glomerular filtration rate. JAMA (2012) 6.26

Association of troponin T detected with a highly sensitive assay and cardiac structure and mortality risk in the general population. JAMA (2010) 6.11

Detection of chronic kidney disease with creatinine, cystatin C, and urine albumin-to-creatinine ratio and association with progression to end-stage renal disease and mortality. JAMA (2011) 6.10

A multilocus genetic risk score for coronary heart disease: case-control and prospective cohort analyses. Lancet (2010) 6.07

Cardiovascular disease risk prediction with and without knowledge of genetic variation at chromosome 9p21.3. Ann Intern Med (2009) 6.00

Carotid-wall intima-media thickness and cardiovascular events. N Engl J Med (2011) 5.94

A sensitive cardiac troponin T assay in stable coronary artery disease. N Engl J Med (2009) 5.81

Carotid intima-media thickness and presence or absence of plaque improves prediction of coronary heart disease risk: the ARIC (Atherosclerosis Risk In Communities) study. J Am Coll Cardiol (2010) 5.79

Performance of common genetic variants in breast-cancer risk models. N Engl J Med (2010) 5.79

Novel and conventional biomarkers for prediction of incident cardiovascular events in the community. JAMA (2009) 5.52

Association of serial measures of cardiac troponin T using a sensitive assay with incident heart failure and cardiovascular mortality in older adults. JAMA (2010) 5.37

Predictive value of brachial flow-mediated dilation for incident cardiovascular events in a population-based study: the multi-ethnic study of atherosclerosis. Circulation (2009) 5.26

Assessing the value of risk predictions by using risk stratification tables. Ann Intern Med (2008) 5.05

Probability of cancer in pulmonary nodules detected on first screening CT. N Engl J Med (2013) 4.64

Predicting the 30-year risk of cardiovascular disease: the framingham heart study. Circulation (2009) 4.62

Integrating the predictiveness of a marker with its performance as a classifier. Am J Epidemiol (2007) 4.59

Association between a literature-based genetic risk score and cardiovascular events in women. JAMA (2010) 4.46

On the C-statistics for evaluating overall adequacy of risk prediction procedures with censored survival data. Stat Med (2011) 4.34

Interpretation of genetic association studies: markers with replicated highly significant odds ratios may be poor classifiers. PLoS Genet (2009) 4.22

Common variants at 10 genomic loci influence hemoglobin A₁(C) levels via glycemic and nonglycemic pathways. Diabetes (2010) 4.07

A combined comorbidity score predicted mortality in elderly patients better than existing scores. J Clin Epidemiol (2011) 3.98

Statistical methods for the time-to-event analysis of individual participant data from multiple epidemiological studies. Int J Epidemiol (2010) 3.97

Lipoprotein particle profiles by nuclear magnetic resonance compared with standard lipids and apolipoproteins in predicting incident cardiovascular disease in women. Circulation (2009) 3.93

Lipid-related markers and cardiovascular disease prediction. JAMA (2012) 3.91

Aortic pulse wave velocity improves cardiovascular event prediction: an individual participant meta-analysis of prospective observational data from 17,635 subjects. J Am Coll Cardiol (2013) 3.89

Cystatin C identifies chronic kidney disease patients at higher risk for complications. J Am Soc Nephrol (2010) 3.85

Red blood cell distribution width and the risk of death in middle-aged and older adults. Arch Intern Med (2009) 3.71

Selection criteria for lung-cancer screening. N Engl J Med (2013) 3.69

Joint effects of common genetic variants on the risk for type 2 diabetes in U.S. men and women of European ancestry. Ann Intern Med (2009) 3.68

Prediction and interaction in complex disease genetics: experience in type 1 diabetes. PLoS Genet (2009) 3.64

Decision making in advanced heart failure: a scientific statement from the American Heart Association. Circulation (2012) 3.61

Statistical methods for assessment of added usefulness of new biomarkers. Clin Chem Lab Med (2010) 3.57

Postoperative biomarkers predict acute kidney injury and poor outcomes after adult cardiac surgery. J Am Soc Nephrol (2011) 3.53

Six-minute walk test as a prognostic tool in stable coronary heart disease: data from the heart and soul study. Arch Intern Med (2012) 3.50

Validation of the Oxford classification of IgA nephropathy in cohorts with different presentations and treatments. Kidney Int (2014) 3.40

Risk implications of the new CKD Epidemiology Collaboration (CKD-EPI) equation compared with the MDRD Study equation for estimated GFR: the Atherosclerosis Risk in Communities (ARIC) Study. Am J Kidney Dis (2010) 3.37

Interpreting incremental value of markers added to risk prediction models. Am J Epidemiol (2012) 3.24

External validation and comparison with other models of the International Metastatic Renal-Cell Carcinoma Database Consortium prognostic model: a population-based study. Lancet Oncol (2013) 3.19

Multicenter validation of the diagnostic accuracy of a blood-based gene expression test for assessing obstructive coronary artery disease in nondiabetic patients. Ann Intern Med (2010) 3.17

Temporal relationship and predictive value of urinary acute kidney injury biomarkers after pediatric cardiopulmonary bypass. J Am Coll Cardiol (2011) 3.17

Prognosis Research Strategy (PROGRESS) 3: prognostic model research. PLoS Med (2013) 3.13

Elevation of circulating branched-chain amino acids is an early event in human pancreatic adenocarcinoma development. Nat Med (2014) 3.09

Kidney injury molecule-1 outperforms traditional biomarkers of kidney injury in preclinical biomarker qualification studies. Nat Biotechnol (2010) 3.07

Calcium density of coronary artery plaque and risk of incident cardiovascular events. JAMA (2014) 3.06

Using relative utility curves to evaluate risk prediction. J R Stat Soc Ser A Stat Soc (2009) 3.04

6-min walk test provides prognostic utility comparable to cardiopulmonary exercise testing in ambulatory outpatients with systolic heart failure. J Am Coll Cardiol (2012) 3.03

Beyond odds ratios--communicating disease risk based on genetic profiles. Nat Rev Genet (2009) 3.01

Pulmonary pressures and death in heart failure: a community study. J Am Coll Cardiol (2012) 2.98

B-type natriuretic peptides and mortality after stroke: a systematic review and meta-analysis. Neurology (2013) 2.98

Diagnostic and prognostic stratification in the emergency department using urinary biomarkers of nephron damage: a multicenter prospective cohort study. J Am Coll Cardiol (2012) 2.97

High-sensitivity troponin T concentrations in acute chest pain patients evaluated with cardiac computed tomography. Circulation (2010) 2.91

The Scientific Foundation for personal genomics: recommendations from a National Institutes of Health-Centers for Disease Control and Prevention multidisciplinary workshop. Genet Med (2009) 2.91

Postoperative biomarkers predict acute kidney injury and poor outcomes after pediatric cardiac surgery. J Am Soc Nephrol (2011) 2.90

Preoperative endogenous ouabain predicts acute kidney injury in cardiac surgery patients. Crit Care Med (2013) 2.89

Comments on 'Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond' by M. J. Pencina et al., Statistics in Medicine (DOI: 10.1002/sim.2929). Stat Med (2008) 2.88

Replicated association between an IL28B gene variant and a sustained response to pegylated interferon and ribavirin. Gastroenterology (2010) 2.83

Assessment of clinical validity of a breast cancer risk model combining genetic and clinical information. J Natl Cancer Inst (2010) 2.82

Derivation and validation of diagnostic thresholds for central blood pressure measurements based on long-term cardiovascular risks. J Am Coll Cardiol (2013) 2.79

Urine neutrophil gelatinase-associated lipocalin moderately predicts acute kidney injury in critically ill adults. J Am Soc Nephrol (2009) 2.77

Net reclassification indices for evaluating risk prediction instruments: a critical review. Epidemiology (2014) 2.67

Arterial wave reflections and incident cardiovascular events and heart failure: MESA (Multiethnic Study of Atherosclerosis). J Am Coll Cardiol (2012) 2.65

Testing for improvement in prediction model performance. Stat Med (2013) 2.62

Polygenic risk score improves prostate cancer risk prediction: results from the Stockholm-1 cohort study. Eur Urol (2011) 2.62

Quantification of biological aging in young adults. Proc Natl Acad Sci U S A (2015) 2.61

Effects of sex on coronary microvascular dysfunction and cardiac outcomes. Circulation (2014) 2.59

Utility of genetic and non-genetic risk factors in prediction of type 2 diabetes: Whitehall II prospective cohort study. BMJ (2010) 2.53

Polygenic type 2 diabetes prediction at the limit of common variant detection. Diabetes (2014) 2.52

C-reactive protein and reclassification of cardiovascular risk in the Framingham Heart Study. Circ Cardiovasc Qual Outcomes (2008) 2.50

Prognostic value of elevated levels of intestinal microbe-generated metabolite trimethylamine-N-oxide in patients with heart failure: refining the gut hypothesis. J Am Coll Cardiol (2014) 2.48

Galectin-3, a marker of cardiac fibrosis, predicts incident heart failure in the community. J Am Coll Cardiol (2012) 2.47

Simple risk model predicts incidence of atrial fibrillation in a racially and geographically diverse population: the CHARGE-AF consortium. J Am Heart Assoc (2013) 2.47

Use of Framingham risk score and new biomarkers to predict cardiovascular mortality in older people: population based observational cohort study. BMJ (2009) 2.46

IL-18 and urinary NGAL predict dialysis and graft recovery after kidney transplantation. J Am Soc Nephrol (2009) 2.43

Cardiovascular risk prediction in diabetic men and women using hemoglobin A1c vs diabetes as a high-risk equivalent. Arch Intern Med (2011) 2.43

Use of serum C reactive protein and procalcitonin concentrations in addition to symptoms and signs to predict pneumonia in patients presenting to primary care with acute cough: diagnostic study. BMJ (2013) 2.40

Development and validation of a dynamic prognostic tool for prostate cancer recurrence using repeated measures of posttreatment PSA: a joint modeling approach. Biostatistics (2009) 2.38

Prognostic utility of cell cycle progression score in men with prostate cancer after primary external beam radiation therapy. Int J Radiat Oncol Biol Phys (2013) 2.35

Potential impact of adding genetic markers to clinical parameters in predicting prostate biopsy outcomes in men following an initial negative biopsy: findings from the REDUCE trial. Eur Urol (2012) 2.34

Association between coronary vascular dysfunction and cardiac mortality in patients with and without diabetes mellitus. Circulation (2012) 2.33

Relations of biomarkers of distinct pathophysiological pathways and atrial fibrillation incidence in the community. Circulation (2010) 2.32

Articles by these authors

General cardiovascular risk profile for use in primary care: the Framingham Heart Study. Circulation (2008) 26.42

Multiple biomarkers for the prediction of first major cardiovascular events and death. N Engl J Med (2006) 15.60

Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers. Stat Med (2010) 14.49

Vitamin D deficiency and risk of cardiovascular disease. Circulation (2008) 13.39

Genetic variants in novel pathways influence blood pressure and cardiovascular disease risk. Nature (2011) 13.25

Abdominal visceral and subcutaneous adipose tissue compartments: association with metabolic risk factors in the Framingham Heart Study. Circulation (2007) 12.79

Obesity and the risk of heart failure. N Engl J Med (2002) 12.58

Metabolite profiles and the risk of developing diabetes. Nat Med (2011) 12.22

Genome-wide association study of blood pressure and hypertension. Nat Genet (2009) 11.54

Overall C as a measure of discrimination in survival analysis: model specific population value and confidence interval estimation. Stat Med (2004) 11.46

Plasma homocysteine as a risk factor for dementia and Alzheimer's disease. N Engl J Med (2002) 11.20

Long-term trends in the incidence of and survival with heart failure. N Engl J Med (2002) 10.37

2013 ACC/AHA guideline on the assessment of cardiovascular risk: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. Circulation (2013) 10.24

The Third Generation Cohort of the National Heart, Lung, and Blood Institute's Framingham Heart Study: design, recruitment, and initial examination. Am J Epidemiol (2007) 9.90

Genotype score in addition to common risk factors for prediction of type 2 diabetes. N Engl J Med (2008) 9.68

Arterial stiffness and cardiovascular events: the Framingham Heart Study. Circulation (2010) 9.09

Stenting and medical therapy for atherosclerotic renal-artery stenosis. N Engl J Med (2013) 8.91

2013 ACC/AHA guideline on the assessment of cardiovascular risk: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines. J Am Coll Cardiol (2013) 8.90

Common genetic determinants of vitamin D insufficiency: a genome-wide association study. Lancet (2010) 8.89

Lifetime risk for development of atrial fibrillation: the Framingham Heart Study. Circulation (2004) 8.80

Incidence of diabetes in youth in the United States. JAMA (2007) 8.70

Prediction of incident diabetes mellitus in middle-aged adults: the Framingham Offspring Study. Arch Intern Med (2007) 8.59

Metabolic syndrome as a precursor of cardiovascular disease and type 2 diabetes mellitus. Circulation (2005) 8.54

Lifetime risk for developing congestive heart failure: the Framingham Heart Study. Circulation (2002) 8.49

Changes in arterial stiffness and wave reflection with advancing age in healthy men and women: the Framingham Heart Study. Hypertension (2004) 8.27

Application of new cholesterol guidelines to a population-based sample. N Engl J Med (2014) 8.22

Obesity and systemic oxidative stress: clinical correlates of oxidative stress in the Framingham Study. Arterioscler Thromb Vasc Biol (2003) 7.47

Development of a risk score for atrial fibrillation (Framingham Heart Study): a community-based cohort study. Lancet (2009) 7.27

The burden of diabetes mellitus among US youth: prevalence estimates from the SEARCH for Diabetes in Youth Study. Pediatrics (2006) 7.19

Plasma natriuretic peptide levels and the risk of cardiovascular events and death. N Engl J Med (2004) 7.12

Clinical utility of different lipid measures for prediction of coronary heart disease in men and women. JAMA (2007) 6.95

Overweight and obesity as determinants of cardiovascular risk: the Framingham experience. Arch Intern Med (2002) 6.92

Residual lifetime risk for developing hypertension in middle-aged women and men: The Framingham Heart Study. JAMA (2002) 6.84

Temporal relations of atrial fibrillation and congestive heart failure and their joint influence on mortality: the Framingham Heart Study. Circulation (2003) 6.83

Obesity and the risk of new-onset atrial fibrillation. JAMA (2004) 6.73

Presentation of multivariate data for clinical use: The Framingham Study risk score functions. Stat Med (2004) 6.42

C-reactive protein, fibrinogen, and cardiovascular disease prediction. N Engl J Med (2012) 6.39

Soft drink consumption and risk of developing cardiometabolic risk factors and the metabolic syndrome in middle-aged adults in the community. Circulation (2007) 6.34

Relations of serum phosphorus and calcium levels to the incidence of cardiovascular disease in the community. Arch Intern Med (2007) 6.29

Aortic stiffness, blood pressure progression, and incident hypertension. JAMA (2012) 6.01

Prediction of lifetime risk for cardiovascular disease by risk factor burden at 50 years of age. Circulation (2006) 5.97

Pericardial fat, visceral abdominal fat, cardiovascular disease risk factors, and vascular calcification in a community-based sample: the Framingham Heart Study. Circulation (2008) 5.95

Carotid-wall intima-media thickness and cardiovascular events. N Engl J Med (2011) 5.94

A genome-wide association study for blood lipid phenotypes in the Framingham Heart Study. BMC Med Genet (2007) 5.64

Predictive value for the Chinese population of the Framingham CHD risk assessment tool compared with the Chinese Multi-Provincial Cohort Study. JAMA (2004) 5.34

Body mass index, metabolic syndrome, and risk of type 2 diabetes or cardiovascular disease. J Clin Endocrinol Metab (2006) 5.33

Long-term outcomes in individuals with prolonged PR interval or first-degree atrioventricular block. JAMA (2009) 5.22

Visceral and subcutaneous adipose tissue volumes are cross-sectionally related to markers of inflammation and oxidative stress: the Framingham Heart Study. Circulation (2007) 5.10

The Framingham Heart Study 100K SNP genome-wide association study resource: overview of 17 phenotype working group reports. BMC Med Genet (2007) 5.02

Effect of pioglitazone compared with glimepiride on carotid intima-media thickness in type 2 diabetes: a randomized trial. JAMA (2006) 4.90

Parental atrial fibrillation as a risk factor for atrial fibrillation in offspring. JAMA (2004) 4.85

Association of smoking cessation and weight change with cardiovascular disease among adults with and without diabetes. JAMA (2013) 4.81

A risk score for predicting stroke or death in individuals with new-onset atrial fibrillation in the community: the Framingham Heart Study. JAMA (2003) 4.77

Trends in cardiovascular complications of diabetes. JAMA (2004) 4.74

Clinical correlates and heritability of flow-mediated dilation in the community: the Framingham Heart Study. Circulation (2004) 4.73

Cross-sectional relations of digital vascular function to cardiovascular risk factors in the Framingham Heart Study. Circulation (2008) 4.69

Parental cardiovascular disease as a risk factor for cardiovascular disease in middle-aged adults: a prospective study of parents and offspring. JAMA (2004) 4.63

Relations of thyroid function to body weight: cross-sectional and longitudinal observations in a community-based sample. Arch Intern Med (2008) 4.63

Predicting the 30-year risk of cardiovascular disease: the framingham heart study. Circulation (2009) 4.62

Effects of Proprotein Convertase Subtilisin/Kexin Type 9 Antibodies in Adults With Hypercholesterolemia: A Systematic Review and Meta-analysis. Ann Intern Med (2015) 4.62

A risk score for predicting near-term incidence of hypertension: the Framingham Heart Study. Ann Intern Med (2008) 4.61

Stroke risk profile predicts white matter hyperintensity volume: the Framingham Study. Stroke (2004) 4.56

Local shear stress and brachial artery flow-mediated dilation: the Framingham Heart Study. Hypertension (2004) 4.56

Impact of obesity on plasma natriuretic peptide levels. Circulation (2004) 4.46

On the C-statistics for evaluating overall adequacy of risk prediction procedures with censored survival data. Stat Med (2011) 4.34

Estimating treatment effects using observational data. JAMA (2007) 4.12

Inflammatory markers and risk of heart failure in elderly subjects without prior myocardial infarction: the Framingham Heart Study. Circulation (2003) 4.09

Low-grade albuminuria and incidence of cardiovascular disease events in nonhypertensive and nondiabetic individuals: the Framingham Heart Study. Circulation (2005) 4.08

Genomewide linkage analysis of body mass index across 28 years of the Framingham Heart Study. Am J Hum Genet (2002) 4.07

Increasing cardiovascular disease burden due to diabetes mellitus: the Framingham Heart Study. Circulation (2007) 3.99

Common variants in KCNN3 are associated with lone atrial fibrillation. Nat Genet (2010) 3.97

Fasting and postchallenge glycemia and cardiovascular disease risk: the Framingham Offspring Study. Diabetes Care (2002) 3.96

Risk factor profile for chronic non-communicable diseases: results of a community-based study in Kerala, India. Indian J Med Res (2010) 3.92

Lipid-related markers and cardiovascular disease prediction. JAMA (2012) 3.91

Metabolic profiling of the human response to a glucose challenge reveals distinct axes of insulin sensitivity. Mol Syst Biol (2008) 3.82

Association of common variants in NPPA and NPPB with circulating natriuretic peptides and blood pressure. Nat Genet (2009) 3.81

Variants in ZFHX3 are associated with atrial fibrillation in individuals of European ancestry. Nat Genet (2009) 3.80