This Critical Synthesis Package contains: (1) a Critical Analysis of the psychometric properties and application to health sciences education for the Assessment of Professional Behaviors (APB) Instrument, and (2) a copy of the APB Instrument and two sample reports from the National Board of Medical Examiners (NBME), developed by the NBME.
The APB program is a multisource feedback program designed to evaluate the observable behaviors of residents/fellows during their clinical training. The core component of the program is a multisource feedback assessment measure, the APB Instrument, which is the focus of this critical analysis. There are two electronic versions of the APB Instrument. One is provided to the resident/fellow (self-assessment) and the other to those observing their behaviors (i.e., faculty, nurses, peers, etc.). Both versions evaluate 23 behaviors, rated using a 5-point frequency scale, as well as two free-text fields intended to provide room for specific critiques and/or praise. Behaviors assessed as part of formative assessment include interpersonal and communication skills, systems based practice, professionalism, and practice-based learning and improvement. The research on this instrument has resulted in mixed outcomes related to response process validity and identified a potential difficulty related to the preparation of successful rater training sessions. Observers’ skills in providing useful written feedback may be amenable to improvement through better modeling, training, and practice. Training that generates awareness of the elements of effective feedback may lead to improved written feedback specific to professionalism.
- To describe the purpose and basic properties of the Assessment of Professional Behaviors (APB) Instrument, including number of items and scales, and psychometric properties;
- To describe the application of the APB Instrument to the field of health sciences education;
- To evaluate the relative strengths and weaknesses of the APB Instrument; and
- To provide the APB and supplemental materials to aid in its administration.
This is an open-access publication distributed under the terms of the Creative Commons Attribution-NonCommercial-Share Alike license.