Effect of rater training on reliability and accuracy of mini-CEX scores: a randomized, controlled trial.

PubWeight™: 1.27‹?› | Rank: Top 10%

🔗 View Article (PMC 2607488)

Published in J Gen Intern Med on November 11, 2008

Authors

David A Cook1, Denise M Dupras, Thomas J Beckman, Kris G Thomas, V Shane Pankratz

Author Affiliations

1: Office of Education Research, College of Medicine, Mayo Clinic, Rochester, MN 55905, USA. cook.david33@mayo.edu

Associated clinical trials:

Faculty Development to Improve Mini-CEX Ratings | NCT00667940

Articles citing this

In-training assessment using direct observation of single-patient encounters: a literature review. Adv Health Sci Educ Theory Pract (2010) 1.20

Validation of a handoff assessment tool: the Handoff CEX. J Clin Nurs (2012) 0.89

Rater training to support high-stakes simulation-based assessments. J Contin Educ Health Prof (2012) 0.88

Improving the Neonatal Research Network annual certification for neurologic examination of the 18-22 month child. J Pediatr (2012) 0.86

A Faculty Development Program to Reduce Rater Error on Milestone-Based Assessments. J Grad Med Educ (2014) 0.84

Effects of a rater training on rating accuracy in a physical examination skills assessment. GMS Z Med Ausbild (2014) 0.78

Work-based assessments: making the transition from participation to engagement. JRSM Open (2014) 0.77

Effects of structured written feedback by cards on medical students' performance at Mini Clinical Evaluation Exercise (Mini-CEX) in an outpatient clinic. J Adv Med Educ Prof (2016) 0.77

Exploration of a possible relationship between examiner stringency and personality factors in clinical assessments: a pilot study. BMC Med Educ (2014) 0.77

Taking OSCE examiner training on the road: reaching the masses. Med Educ Online (2016) 0.75

Uncertainty, Case Complexity and the Content of Verbal Handoffs at the Emergency Department. AMIA Annu Symp Proc (2015) 0.75

Achieving the AAAs of Ambulatory Care: Aptitude, Appeal, and Appreciation. J Grad Med Educ (2009) 0.75

Direct Observation Assessment of Milestones: Problems with Reliability. West J Emerg Med (2015) 0.75

An Internal Medicine Simulated Practical Examination for Assessment of Clinical Competency in Third-Year Medical Students. Simul Healthc (2015) 0.75

The influence of students' prior clinical skills and context characteristics on mini-CEX scores in clerkships - a multilevel analysis. BMC Med Educ (2015) 0.75

Stakeholder perspectives on workplace-based performance assessment: towards a better understanding of assessor behaviour. Adv Health Sci Educ Theory Pract (2017) 0.75

Articles cited by this

The measurement of observer agreement for categorical data. Biometrics (1977) 216.56

Longitudinal data analysis for discrete and continuous outcomes. Biometrics (1986) 60.93

Sample size and optimal designs for reliability studies. Stat Med (1998) 6.80

The mini-CEX: a method for assessing clinical skills. Ann Intern Med (2003) 5.05

How well do internal medicine faculty members evaluate the clinical skills of residents? Ann Intern Med (1992) 3.78

Enriched rater training using Internet based technologies: a comparison to traditional rater training in a multi-site depression trial. J Psychiatr Res (2005) 3.41

Research in clinical reasoning: past history and current trends. Med Educ (2005) 3.23

Effects of training in direct observation of medical residents' clinical competence: a randomized trial. Ann Intern Med (2004) 2.98

The mini-CEX (clinical evaluation exercise): a preliminary investigation. Ann Intern Med (1995) 2.72

Methods for evaluating the clinical competence of residents in internal medicine: a review. Ann Intern Med (1998) 2.72

Construct validity of the miniclinical evaluation exercise (miniCEX). Acad Med (2003) 2.25

Cognitive, social and environmental sources of bias in clinical performance ratings. Teach Learn Med (2003) 2.24

The selection and training of examiners for clinical examinations. Med Educ (1980) 1.68

Clinical competence certification: a critical appraisal. J Med Educ (1984) 1.47

The inter-rater reliability and internal consistency of a clinical evaluation exercise. J Gen Intern Med (1993) 1.43

Does feedback matter? Practice-based learning for medical students after a multi-institutional clinical performance examination. Med Educ (2007) 1.32

Effectiveness of a focused educational intervention on resident evaluations from faculty a randomized controlled trial. J Gen Intern Med (2001) 1.26

Feasibility, reliability, and validity of the mini-clinical evaluation exercise (mCEX) in a medicine core clerkship. Acad Med (2003) 1.21

How accurate are faculty evaluations of clinical competence? J Gen Intern Med (1989) 1.20

Standardized rater training for the Hamilton Depression Rating Scale (HAMD-17) in psychiatric novices. J Affect Disord (2003) 1.06

Use of the mini-clinical evaluation exercise to rate examinee performance on a multiple-station clinical skills examination: a validity study. Acad Med (2006) 1.05

Identifying the factors that determine feedback given to undergraduate medical students following formative mini-CEX assessments. Med Educ (2007) 1.04

Raters who pursue different goals give different ratings. J Appl Psychol (2004) 1.00

Evaluation of standardized rater training for the Positive and Negative Syndrome Scale (PANSS). Schizophr Res (1998) 0.90

Assessing the mini-Clinical Evaluation Exercise in comparison to a national specialty examination. Med Educ (2006) 0.89

Didactic value of the clinical evaluation exercise. Missed opportunities. J Gen Intern Med (1996) 0.79

Effects of training intensity on observers' ratings of anxiety, social skills, and alcohol-specific coping skills. Behav Res Ther (2005) 0.78

A comparative trial of the clinical evaluation exercise. Arch Intern Med (1985) 0.78

Articles by these authors

Genome-wide association study identifies variants at CLU and PICALM associated with Alzheimer's disease. Nat Genet (2009) 15.15

Genome-wide analysis of genetic loci associated with Alzheimer disease. JAMA (2010) 9.52

Common variants at ABCA7, MS4A6A/MS4A4E, EPHA1, CD33 and CD2AP are associated with Alzheimer's disease. Nat Genet (2011) 9.23

Internet-based learning in the health professions: a meta-analysis. JAMA (2008) 8.74

Benign breast disease and the risk of breast cancer. N Engl J Med (2005) 6.84

The Mayo Clinic Study of Aging: design and sampling, participation, baseline measures and sample characteristics. Neuroepidemiology (2008) 5.94

Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med (2006) 5.80

Age-related lobular involution and risk of breast cancer. J Natl Cancer Inst (2006) 5.12

A locus on 19p13 modifies risk of breast cancer in BRCA1 mutation carriers and is associated with hormone receptor-negative breast cancer in the general population. Nat Genet (2010) 4.96

Nurse staffing and inpatient hospital mortality. N Engl J Med (2011) 4.51

Genetic variation in PCDH11X is associated with susceptibility to late-onset Alzheimer's disease. Nat Genet (2009) 4.00

Instructional design variations in internet-based learning for health professions education: a systematic review and meta-analysis. Acad Med (2010) 3.56

Genetic variants and risk of lung cancer in never smokers: a genome-wide association study. Lancet Oncol (2010) 3.49

The lifetime risk of suicide in schizophrenia: a reexamination. Arch Gen Psychiatry (2005) 3.15

Association between funding and quality of published medical education research. JAMA (2007) 3.11

Mammographic breast density as a general marker of breast cancer risk. Cancer Epidemiol Biomarkers Prev (2007) 2.81

Higher risk of progression to dementia in mild cognitive impairment cases who revert to normal. Neurology (2013) 2.73

Mammographic density, breast cancer risk and risk prediction. Breast Cancer Res (2007) 2.71

Quality of reporting of experimental studies in medical education: a systematic review. Med Educ (2007) 2.67

Stratification of breast cancer risk in women with atypia: a Mayo cohort study. J Clin Oncol (2007) 2.58

Genetic evidence implicates the immune system and cholesterol metabolism in the aetiology of Alzheimer's disease. PLoS One (2010) 2.57

How common is attention-deficit/hyperactivity disorder? Incidence in a population-based birth cohort in Rochester, Minn. Arch Pediatr Adolesc Med (2002) 2.51

General medicine vs subspecialty career plans among internal medicine residents. JAMA (2012) 2.50

A practical guide to developing effective web-based learning. J Gen Intern Med (2004) 2.42

What do we mean by web-based learning? A systematic review of the variability of interventions. Med Educ (2010) 2.38

Standards for reporting qualitative research: a synthesis of recommendations. Acad Med (2014) 2.35

Brain expression genome-wide association study (eGWAS) identifies human disease-associated variants. PLoS Genet (2012) 2.23

Depression, apolipoprotein E genotype, and the incidence of mild cognitive impairment: a prospective cohort study. Arch Neurol (2006) 2.13

Incidence of dementia among participants and nonparticipants in a longitudinal study of cognitive aging. Am J Epidemiol (2014) 2.09

Novel late-onset Alzheimer disease loci variants associate with brain gene expression. Neurology (2012) 2.08

Age-specific trends in mammographic density: the Minnesota Breast Cancer Family Study. Am J Epidemiol (2008) 2.06

Association of duration and severity of diabetes mellitus with mild cognitive impairment. Arch Neurol (2008) 2.04

Validation of the telephone interview for cognitive status-modified in subjects with normal cognition, mild cognitive impairment, or dementia. Neuroepidemiology (2009) 2.03

Physical exercise, aging, and mild cognitive impairment: a population-based study. Arch Neurol (2010) 2.02

Replication of CLU, CR1, and PICALM associations with alzheimer disease. Arch Neurol (2010) 2.02

An evaluation of internal medicine residency continuity clinic redesign to a 50/50 outpatient-inpatient model. J Gen Intern Med (2013) 1.99

Visiting medical student elective and clerkship programs: a survey of US and Puerto Rico allopathic medical schools. BMC Med Educ (2010) 1.97

Longitudinal trends in mammographic percent density and breast cancer risk. Cancer Epidemiol Biomarkers Prev (2007) 1.90

Web-based learning in residents' continuity clinics: a randomized, controlled trial. Acad Med (2005) 1.82

Mild cognitive impairment associated with limbic and neocortical Lewy body disease: a clinicopathological study. Brain (2009) 1.77

Common variants in ZNF365 are associated with both mammographic density and breast cancer risk. Nat Genet (2011) 1.77

AURKA F31I polymorphism and breast cancer risk in BRCA1 and BRCA2 mutation carriers: a consortium of investigators of modifiers of BRCA1/2 study. Cancer Epidemiol Biomarkers Prev (2007) 1.75

The contribution of HLA class I antigens in immune status following two doses of rubella vaccination. Hum Immunol (2004) 1.70

Association between mammographic density and age-related lobular involution of the breast. J Clin Oncol (2010) 1.70

Texture features from mammographic images and risk of breast cancer. Cancer Epidemiol Biomarkers Prev (2009) 1.65

Impact of self-assessment questions and learning styles in Web-based learning: a randomized, controlled, crossover trial. Acad Med (2006) 1.62

Associations between SNPs in toll-like receptors and related intracellular signaling molecules and immune responses to measles vaccine: preliminary results. Vaccine (2008) 1.60

The epidemiology of narcolepsy in Olmsted County, Minnesota: a population-based study. Sleep (2002) 1.60

Behaviors of highly professional resident physicians. JAMA (2008) 1.58

Polyunsaturated fatty acids and reduced odds of MCI: the Mayo Clinic Study of Aging. J Alzheimers Dis (2010) 1.58

Risks of high-dose stimulants in the treatment of disorders of excessive somnolence: a case-control study. Sleep (2005) 1.56

Human leukocyte antigen haplotypes in the genetic control of immune response to measles-mumps-rubella vaccine. J Infect Dis (2006) 1.54

Lymphocyte-rich gastric cancer: associations with Epstein-Barr virus, microsatellite instability, histology, and survival. Mod Pathol (2003) 1.50

Probable rapid eye movement sleep behavior disorder increases risk for mild cognitive impairment and Parkinson disease: a population-based study. Ann Neurol (2012) 1.49

p16(INK4a) expression and breast cancer risk in women with atypical hyperplasia. Cancer Prev Res (Phila) (2011) 1.45

Independence of measles-specific humoral and cellular immune responses to vaccination. Hum Immunol (2012) 1.44

Genetic variation in the one-carbon transfer pathway and ovarian cancer risk. Cancer Res (2008) 1.42

Human leukocyte antigen and cytokine receptor gene polymorphisms associated with heterogeneous immune responses to mumps viral vaccine. Pediatrics (2008) 1.41

Association of prior stroke with cognitive function and cognitive impairment: a population-based study. Arch Neurol (2009) 1.40

Association of genetic variation in genes implicated in the beta-catenin destruction complex with risk of breast cancer. Cancer Epidemiol Biomarkers Prev (2008) 1.39

Retail clinic visits: are resident paneled patients more likely to make multiple visits? Fam Med (2012) 1.39

Gender effects on humoral immune responses to smallpox vaccine. Vaccine (2009) 1.39

Searching the medical literature using PubMed: a tutorial. Mayo Clin Proc (2003) 1.38

Histologic grade is an independent prognostic factor for survival in non-small cell lung cancer: an analysis of 5018 hospital- and 712 population-based cases. J Thorac Cardiovasc Surg (2006) 1.37

Intraoperative transesophageal echocardiography during surgery for congenital heart defects. J Thorac Cardiovasc Surg (2002) 1.36

Associations between measles vaccine immunity and single-nucleotide polymorphisms in cytokine and cytokine receptor genes. J Infect Dis (2006) 1.35

Human leukocyte antigen class II alleles and rubella-specific humoral and cell-mediated immunity following measles-mumps-rubella-II vaccination. J Infect Dis (2005) 1.35

Predictive validity evidence for medical education research study quality instrument scores: quality of submissions to JGIM's Medical Education Special Issue. J Gen Intern Med (2008) 1.34

Relationship between critical reflection and quality improvement proposal scores in resident doctors. Med Educ (2010) 1.32

Performance of amplified DNA in an Illumina GoldenGate BeadArray assay. Cancer Epidemiol Biomarkers Prev (2008) 1.32

Polymorphisms in the vitamin A receptor and innate immunity genes influence the antibody response to rubella vaccination. J Infect Dis (2010) 1.31

Validation of a method for assessing resident physicians' quality improvement proposals. J Gen Intern Med (2007) 1.30

2'-5'-Oligoadenylate synthetase single-nucleotide polymorphisms and haplotypes are associated with variations in immune responses to rubella vaccine. Hum Immunol (2010) 1.30

A novel automated mammographic density measure and breast cancer risk. J Natl Cancer Inst (2012) 1.28

HLA class II alleles and measles virus-specific cytokine immune response following two doses of measles vaccine. Immunogenetics (2005) 1.28

Association of single nucleotide polymorphisms in glycosylation genes with risk of epithelial ovarian cancer. Cancer Epidemiol Biomarkers Prev (2008) 1.26

Strong evidence of a genetic determinant for mammographic density, a major risk factor for breast cancer. Cancer Res (2007) 1.26

Metastatic prostate carcinoma to bone: clinical and pathologic features associated with cancer-specific survival. Cancer (2002) 1.26

Common breast cancer susceptibility variants in LSP1 and RAD51L1 are associated with mammographic density measures that predict breast cancer risk. Cancer Epidemiol Biomarkers Prev (2012) 1.26

Ki67: a time-varying biomarker of risk of breast cancer in atypical hyperplasia. Breast Cancer Res Treat (2009) 1.25

Estrogen bioactivation, genetic polymorphisms, and ovarian cancer. Cancer Epidemiol Biomarkers Prev (2005) 1.25

A comprehensive examination of CYP19 variation and risk of breast cancer using two haplotype-tagging approaches. Breast Cancer Res Treat (2006) 1.25

Associations between single nucleotide polymorphisms and haplotypes in cytokine and cytokine receptor genes and immunity to measles vaccination. Vaccine (2011) 1.24

Variations in measles vaccine-specific humoral immunity by polymorphisms in SLAM and CD46 measles virus receptors. J Allergy Clin Immunol (2007) 1.24

Novel breast tissue feature strongly associated with risk of breast cancer. J Clin Oncol (2009) 1.23

Genome-wide association study of antibody response to smallpox vaccine. Vaccine (2012) 1.23

Independent association of lobular involution and mammographic breast density with breast cancer risk. J Natl Cancer Inst (2010) 1.23

Association between cyclooxygenase-2 expression in atypical hyperplasia and risk of breast cancer. J Natl Cancer Inst (2008) 1.22

Resident physicians' knowledge of underserved patients: a multi-institutional survey. Mayo Clin Proc (2010) 1.21

Reflections on experimental research in medical education. Adv Health Sci Educ Theory Pract (2008) 1.20

Interaction of waist/hip ratio and family history on the risk of hormone receptor-defined breast cancer in a prospective study of postmenopausal women. Am J Epidemiol (2002) 1.20

Psychiatric manifestations of Creutzfeldt-Jakob disease: a 25-year analysis. J Neuropsychiatry Clin Neurosci (2005) 1.20

An assessment of the methodologic quality of medical education research studies published in The American Journal of Surgery. Am J Surg (2009) 1.19

Comparison of percent density from raw and processed full-field digital mammography data. Breast Cancer Res (2013) 1.19

Association of mammographic density with the pathology of subsequent breast cancer among postmenopausal women. Cancer Epidemiol Biomarkers Prev (2008) 1.19

A large observational study to concurrently assess persistence of measles specific B-cell and T-cell immunity in individuals following two doses of MMR vaccine. Vaccine (2011) 1.18