Effective evaluation is a cornerstone of medical education. The ACGME requires that trainees are assessed and provided feedback for each rotation, and that competency-based, multi-source evaluation is incorporated. National data from the ACGME’s 2013 resident survey indicates dissatisfaction with faculty feedback among 27% of residents; this finding has been consistent over several years. ACGME migration to milestones as part of the Next Accreditation System (NAS) has helped focus increased graduate medical education director and faculty attention on assessment and underscores the potential usefulness of thoughtfully developed standardized evaluations. Semi-annual reporting of individual achievement of specified milestones must rely upon ongoing formative (e.g., end of rotation) assessment utilizing a variety of tools. Indeed, the ACGME continues to require formative, competency-based multi-source assessment at the conclusion of each rotation or educational assignment. This work represents a collection of multi-source assessment tools (e.g., evaluation of trainee by faculty, peer, other healthcare professional, self- assessment) intended for formative competency-based feedback and evaluation. They meet ACGME requirements for formative competency-based evaluation at the end of each rotation and are intended for multi-source assessment in both ACGME and non-ACGME residency and fellowship programs. Content included relates to knowledge, skills, and behavior relevant to all specialties. This will be particularly important as specialty-based milestones are determined at the national level. The resulting assessment tools provide multi-source, competency-based evaluation for assessment of ACGME trainees. They have been provided to the approximately 100 ACGME-accredited GME programs at Massachusetts General and Brigham and Women’s hospitals and are currently in use by 36 programs. Twenty-four faculty development sessions have been provided since 2011. These sessions introduce the assessment tools with tips for implementation and evidence-based feedback and evaluation strategies. Competency-based 360 assessment tools combined with faculty development may improve the quality and consistency of feedback and evaluation of trainees. These assessment tools provide the framework for ongoing formative verbal feedback, end of rotation formative evaluation as required by the ACGME, and serve to inform the biannual specialty-specific milestone assessments.
- Utilize formative competency-based, multi-source evaluation of residents and fellows in ACGME accredited graduate medical education programs to inform summative milestone assessment.
- Provide formative multi-source assessment tools to ACGME programs not yet reporting milestones.
- Provide multi-source assessment tools to non-ACGME programs in an effort to standardize an approach to multi-source evaluation tools as the cornerstone for end-of-rotation written evaluation, and as a vehicle for facilitating verbal feedback.
- Provide standard templates for multi-source trainee evaluations that can be used across specialties and customized, as needed.
- Utilize an institutionally approved assessment tool as a key element in faculty development focused on assessment.
- Create an opportunity to benchmark performance and facilitate comparisons across programs and specialties.
None to report.
None to report.
Goldhamer ME, Baker KH, Rigg A, Weinstein DF. Development and implementation of multi-source assessment tools for ACGME residents and fellows. Presented at: Association of American Medical Colleges Annual Meeting; November 2013; Philadelphia, PA.
This is an open-access publication distributed under the terms of the Creative Commons Attribution-NonCommercial license.