Faculty Development Series on Assessment in Graduate Medical Education: The Milestone Project
This resource is a set of PowerPoint slides designed for the purpose of faculty development. The slides are intended for presentation by a residency program director (or designee) in a didactic or workshop setting for the purpose of introducing faculty to the Milestone Project and its utility in assessing resident performance. This presentation is the second of a six-part series that were commissioned by the Program Directors Committee of the American Board of Pediatrics based on their publication entitled Assessment in Graduate Medical Education: A Primer for Pediatric Program Directors. This case-based presentation begins with a perspective of how residency programs and their trainees have been assessed over the past decade. It then explores and demonstrates problems with traditional methods of assessment using an interactive, non-medical video example and a typical assessment tool. The presentation then introduces the concept of The Pediatrics Milestone Project as one of the changes implemented with the Next Accreditation System. It reviews the origins of the Milestones Project, how it is framed by the existing competencies, and its utility in improving resident assessment. The module continues with a video where the participants are asked to assess the performance of the learner using traditional methods, followed by Milestone methods. At the conclusion, the concepts of the Clinical Competency Committee and Entrustable Professional Activities are introduced. In our experiences using this material, the authors have found that participants are quick to acknowledge the issues with traditional evaluation tools after viewing both the non-medical and medical video scenarios. The effectiveness of assessment with narrative anchors is also readily evident when these tools are used instead of the traditional ones. The participants valued the experience of rating themselves on several competencies, since some found that, even as experienced independent practitioners, they had not always attained the skills described in “Milestone 5.” In this way, they felt justified in placing early learners on the lower Milestones, and did not feel the pressure to “inflate” them higher. In terms of implementing the Milestone Project, the participants, who were mainly core faculty and rotation directors, were supportive of changing the existing evaluation tools to better inform the Milestone process.
By the end of this session, learners will:
Review the history of resident assessment.
Identify problems with the traditional assessment methods.
Understand the origins and goals of the Milestone Project.
Understand the Milestone process flow and how it is framed by the current competency domains.
Apply a variety of assessment tools to case scenarios to determine effectiveness of each.
Define the Clinical Competency Committee and Entrustable Professional Activities as they relate to the Milestone Process.
Eckart C. Succeeding in the ACGME's NAS: Strategies for Program Administrators and Coordinators. 2012.Google Scholar Carracio C, et al. The Pediatrics Milestone Project. January 2012.Google Scholar Gilhooly J, Fischer C. ACGME NAS Design Updates. 2012.Google Scholar Hicks PJ, Englander R, Schumacher DJ, Burke A, Benson BJ, Guralnick S, Ludwig S, Carraccio C. Pediatrics milestone project: next steps toward meaningful outcomes assessment, J Grad Med Educ.2010;2(4):577–84. http://dx.doi.org/10.4300/JGME-D-10-00157.1Google Scholar, Hicks PJ, Schumacher DJ, Benson BJ, Burke AE, Englander R, Guralnick S, Ludwig S, Carraccio C. The pediatrics milestones: conceptual framework, guiding principles, and approach to development, J Grad Med Educ.2010;2(3):410–8. http://dx.doi.org/10.4300/JGME-D-10-00126.1Google Scholar, Kogan JR, Conforti L, Bernabeo E, Iobst W, Holmboe E. Opening the black box of clinical skills assessment via observation: a conceptual model, Medical Education.2011: 45:1048–1060. http://dx.doi.org/10.1111/j.1365-2923.2011.04025.xGoogle Scholar, Lieh-Lai MW, 2012. The Next Accreditation System Association of Pediatric Program Directors Conference. Accreditation Council for Graduate Medical Education. October 2012.Google Scholar Nasca TJ, Philibert I, Brigham T, Flynn TC. The next GME accreditation system–rationale and benefits, N Engl J Med.2012;366(11):1051–1056. http://dx.doi.org/10.1056/NEJMsr1200117Google Scholar,
- Youtube: https://www.youtube.com/watchv=z8_n3C_ZZHEGoogle Scholar