Using Milestones as Evaluation Metrics During an Emergency Medicine Clerkship.
Publication/Presentation Date
7-26-2016
Abstract
BACKGROUND: The Accreditation Council for Graduate Medical Education's (ACGME) Milestones presumes graduating medical students will enter residency proficient at Milestone level 1 for 23 skills. The Next Accreditation System now includes Milestones for each postgraduate specialty, and it is unlikely that schools will document every emergency medicine (EM) applicant's EM-specific skills in their performance evaluation.
OBJECTIVES: The goals of this research were to determine if assessment of the Milestones was feasible during a medical student clerkship and examine the proportion of medical students performing at Milestone level 1.
METHODS: This study was conducted at a center with Liaison Committee on Medical Education-approved medical training and a 4-year EM residency. Using traditional clerkship, we studied the feasibility of an ACGME EM Milestones-based clerkship assessment. Data led to redesign of the clerkship and its evaluation process, including all level 1 anchor(s) to add "occasionally" (>60%), "usually" (>80%), and "always" (100%) on a Likert scale to on-shift assessment forms.
RESULTS: During the feasibility phase (2013-14), 75 students rotated though the clerkship; 55 evaluations were issued and 50 contained the Milestone summary. Eight deficiencies were noted in Milestone 12 and three in Milestone 14. After changes, 49 students rotated under the new evaluation rubric. Of 575 completed on-shift evaluations, 16 Milestone deficiencies were noted. Of 41 institutional evaluations issued, only one student had deficiencies noted, all of which pertained to patient care. All evaluations in this second cohort contained each student's Milestone proficiency.
CONCLUSIONS: Assessment of the Milestones is feasible. Communication of ACGME EM Milestone proficiency may identify students who require early observation or remediation. The majority of students meet the anchors for the Milestones, suggesting that clerkship assessment with the ACGME EM Milestones does not adequately differentiate students.
Volume
51
Issue
4
First Page
426
Last Page
431
ISSN
0736-4679
Published In/Presented At
Quinn, S. M., Worrilow, C. C., Jayant, D. A., Bailey, B., Eustice, E., Kohlhepp, J., & ... Kane, B. G. (2016). Using Milestones as Evaluation Metrics During an Emergency Medicine Clerkship. The Journal Of Emergency Medicine, 51(4), 426-431. doi:10.1016/j.jemermed.2016.06.014.
Disciplines
Emergency Medicine
PubMedID
27473442
Department(s)
Department of Emergency Medicine, Department of Emergency Medicine Faculty, Department of Emergency Medicine Residents, Fellows and Residents
Document Type
Article