External validation of clinical prediction models using big datasets from e-health records or IPD meta-analysis: opportunities and challenges.

PubWeight™: 0.96‹?› | Rank: Top 15%

🔗 View Article (PMID 27334381)

Published in BMJ on June 22, 2016

Authors

Richard D Riley1, Joie Ensor2, Kym I E Snell3, Thomas P A Debray4, Doug G Altman5, Karel G M Moons4, Gary S Collins5

Author Affiliations

1: Research Institute for Primary Care and Health Sciences, Keele University, Keele ST5 5BG, Staffordshire, UK r.riley@keele.ac.uk.
2: Research Institute for Primary Care and Health Sciences, Keele University, Keele ST5 5BG, Staffordshire, UK.
3: Institute of Applied Health Research, University of Birmingham, Edgbaston, Birmingham, UK.
4: Julius Centre for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, Netherlands Cochrane Netherlands, University Medical Center Utrecht, Utrecht, Netherlands.
5: Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK.

Articles cited by this

Cardiovascular disease risk profiles. Am Heart J (1991) 21.65

A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol (1996) 20.25

Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making (2006) 11.83

Problems of spectrum and bias in evaluating the efficacy of diagnostic tests. N Engl J Med (1978) 11.42

Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. J Clin Epidemiol (2001) 10.16

Predicting cardiovascular risk in England and Wales: prospective derivation and validation of QRISK2. BMJ (2008) 7.60

A prognostic index in primary breast cancer. Br J Cancer (1982) 7.35

Prognosis and prognostic research: validating a prognostic model. BMJ (2009) 6.54

The Nottingham Prognostic Index in primary breast cancer. Breast Cancer Res Treat (1992) 6.51

Value of assessment of pretest probability of deep-vein thrombosis in clinical management. Lancet (1998) 6.04

Meta-analysis of individual participant data: rationale, conduct, and reporting. BMJ (2010) 5.60

Translating clinical research into clinical practice: impact of using prediction rules to make decisions. Ann Intern Med (2006) 5.17

A new measure of prognostic separation in survival data. Stat Med (2004) 4.98

Data Resource Profile: Clinical Practice Research Datalink (CPRD). Int J Epidemiol (2015) 4.87

Derivation of a simple clinical model to categorize patients probability of pulmonary embolism: increasing the models utility with the SimpliRED D-dimer. Thromb Haemost (2000) 4.81

Predicting outcome after traumatic brain injury: development and international validation of prognostic scores based on admission characteristics. PLoS Med (2008) 4.60

Prognosis and prognostic research: what, why, and how? BMJ (2009) 4.46

An independent and external validation of QRISK2 cardiovascular disease risk score: a prospective open cohort study. BMJ (2010) 4.46

Prognosis and prognostic research: application and impact of prognostic models in clinical practice. BMJ (2009) 4.38

Prognosis and prognostic research: Developing a prognostic model. BMJ (2009) 4.38

Interpretation of random effects meta-analyses. BMJ (2011) 4.32

Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): the TRIPOD statement. Ann Intern Med (2015) 4.32

Predicting the 10 year risk of cardiovascular disease in the United Kingdom: independent and external validation of an updated version of QRISK2. BMJ (2012) 4.03

Predicting risk of type 2 diabetes in England and Wales: prospective derivation and validation of QDScore. BMJ (2009) 3.68

External validation is necessary in prediction research: a clinical example. J Clin Epidemiol (2003) 3.49

The Wells rule does not adequately rule out deep venous thrombosis in primary care patients. Ann Intern Med (2005) 3.21

Prognosis Research Strategy (PROGRESS) 3: prognostic model research. PLoS Med (2013) 3.13

Undue reliance on I(2) in assessing heterogeneity may mislead. BMC Med Res Methodol (2008) 3.06

Spectrum bias or spectrum effect? Subgroup variation in diagnostic test evaluation. Ann Intern Med (2002) 2.99

Exclusion of deep vein thrombosis using the Wells rule in clinically important subgroups: individual patient data meta-analysis. BMJ (2014) 2.80

Risk prediction models: I. Development, internal validation, and assessing the incremental value of a new (bio)marker. Heart (2012) 2.76

Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): explanation and elaboration. Ann Intern Med (2015) 2.71

Preferred Reporting Items for Systematic Review and Meta-Analyses of individual participant data: the PRISMA-IPD Statement. JAMA (2015) 2.68

Substantial effective sample sizes were required for external validation studies of predictive logistic regression models. J Clin Epidemiol (2005) 2.42

Prognosis research strategy (PROGRESS) 1: a framework for researching clinical outcomes. BMJ (2013) 2.31

Reporting and methods in clinical prediction research: a systematic review. PLoS Med (2012) 2.26

Prognosis Research Strategy (PROGRESS) 2: prognostic factor research. PLoS Med (2013) 2.23

External validity of risk models: Use of benchmark values to disentangle a case-mix effect from incorrect coefficients. Am J Epidemiol (2010) 2.03

Updating methods improved the performance of a clinical prediction model in new patients. J Clin Epidemiol (2007) 2.01

External validation of a Cox prognostic model: principles and methods. BMC Med Res Methodol (2013) 1.88

Assessment of publication bias, selection bias, and unavailable data in meta-analyses using individual participant data: a database survey. BMJ (2012) 1.80

Prognosis research strategy (PROGRESS) 4: stratified medicine research. BMJ (2013) 1.71

Reporting performance of prognostic models in cancer: a review. BMC Med (2010) 1.65

External validation of multivariable prediction models: a systematic review of methodological conduct and reporting. BMC Med Res Methodol (2014) 1.57

Why data sharing should be the expected norm. BMJ (2015) 1.49

A new framework to enhance the interpretation of external validation studies of clinical prediction models. J Clin Epidemiol (2014) 1.44

Construction and validation of a prognostic model across several studies, with an application in superficial bladder cancer. Stat Med (2004) 1.36

Sample size considerations for the external validation of a multivariable prognostic model: a resampling study. Stat Med (2015) 1.35

Variation of a test's sensitivity and specificity with disease prevalence. CMAJ (2013) 1.27

A calibration hierarchy for risk models was defined: from utopia to empirical data. J Clin Epidemiol (2016) 1.17

Multiple imputation for handling systematically missing confounders in meta-analysis of individual participant data. Stat Med (2013) 1.16

Individual participant data meta-analysis of prognostic factor studies: state of the art? BMC Med Res Methodol (2012) 1.15

Comparison of non-parametric confidence intervals for the area under the ROC curve of a continuous-scale diagnostic test. Stat Methods Med Res (2008) 1.10

Fracture risk assessment: state of the art, methodologically unsound, or poorly reported? Curr Osteoporos Rep (2012) 1.07

A framework for developing, implementing, and evaluating clinical prediction models in an individual participant data meta-analysis. Stat Med (2013) 1.05

Between iatrotropic stimulus and interiatric referral: the domain of primary care research. J Clin Epidemiol (2002) 1.01

Prognostic factors. Confusion caused by bad quality design, analysis and reporting of many studies. Adv Otorhinolaryngol (2005) 0.99

Predicting mortality with pneumonia severity scores: importance of model recalibration to local settings. Epidemiol Infect (2008) 0.97

Individual Participant Data (IPD) Meta-analyses of Randomised Controlled Trials: Guidance on Their Use. PLoS Med (2015) 0.96

Assessing risk prediction models using individual participant data from multiple studies. Am J Epidemiol (2013) 0.95

How to develop a more accurate risk prediction model when there are few events. BMJ (2015) 0.94

Comparing risk prediction models. BMJ (2012) 0.94

Aggregating published prediction models with individual participant data: a comparison of different approaches. Stat Med (2012) 0.92

Ethnic group differences in cardiovascular risk assessment scores: national cross-sectional study. Ethn Health (2013) 0.91

Imputation of systematically missing predictors in an individual participant data meta-analysis: a generalized approach using MICE. Stat Med (2015) 0.90

The rise of big clinical databases. Br J Surg (2015) 0.89

Developing and validating risk prediction models in an individual participant data meta-analysis. BMC Med Res Methodol (2014) 0.89

Multivariate meta-analysis of individual participant data helped externally validate the performance and implementation of a prediction model. J Clin Epidemiol (2015) 0.89

Summarising and validating test accuracy results across multiple studies for use in clinical practice. Stat Med (2015) 0.85

Uptake of systematic reviews and meta-analyses based on individual participant data in clinical practice guidelines: descriptive study. BMJ (2015) 0.85

Screening for data clustering in multicenter studies: the residual intraclass correlation. BMC Med Res Methodol (2013) 0.85

Assessing discriminative ability of risk models in clustered data. BMC Med Res Methodol (2014) 0.83

Estimating a test's accuracy using tailored meta-analysis-How setting-specific data may aid study selection. J Clin Epidemiol (2014) 0.81

Individual Participant Data (IPD) Meta-analyses of Diagnostic and Prognostic Modeling Studies: Guidance on Their Use. PLoS Med (2015) 0.79

Adequate sample size for developing prediction models is not simply related to events per variable. J Clin Epidemiol (2016) 0.78

QRISK2 validation by ethnic group. Heart (2013) 0.76

Discrimination-based sample size calculations for multivariable prognostic models for time-to-event data. BMC Med Res Methodol (2015) 0.76