Original Publication
Open Access

Three Standardized Patient Cases to Measure Screening, Brief Intervention and Referral to Treatment (SBIRT) Skills in Primary Care Residents

Published: September 13, 2011 | 10.15766/mep_2374-8265.9005

Included in this publication:

  • Case 1 Post-Case Scoring Rubric.xls
  • Case 1 Post-case exercise.doc
  • Case 1 Standardized Patient Training Materials.doc
  • Case 2 Post-Case Exercise.doc
  • Case 2 Post-Case Scoring Rubric.doc
  • Case 2 Standardized Patient Training Materials.doc
  • Case 3 Post-Case Exercise.doc
  • Case 3 Post-case Scoring Rubric.doc
  • Case 3 Standardized Patient Training Materials.doc
  • Debrief Session Guide for Faculty.doc
  • Resident Evaluation of Standardized Patient Activity.xls
  • SBIRT SP Case Objectives and Checklist Items.pdf
  • SBIRT Standardized Patient Scoring Rubric.doc

To view all publication components, extract (i.e., unzip) them from the downloaded .zip file.


Editor's Note: This publication predates our implementation of the Educational Summary Report in 2016 and thus displays a different format than newer publications.

Abstract

Three twenty-minute standardized patient encounters that are designed for internal medicine or family medicine residents to assess SBIRT skills and to determine individual areas for improvement. Standardized patient cases include the following:

  • 35 year-old man with risky alcohol use and paroxysmal atrial fibrillation, contemplative stage.
  • 39 year-old woman with low back pain and opiate misuse, precontemplative stage.
  • 63 year-old woman with depression and alcohol use disorder, preparation stage.

Each case is written to represent a twenty-minute clinic visit and focuses on substance use history taking, assessment and development of a clear treatment plan. There are no physical exams included in these cases, but if desired the cases could be modified to assess relevant physical examination skills. After each SP case, residents have a ten-minute exercise to assess specific knowledge and skills including: encounter documentation, assessment of stages of change, approach to older patients with substance use, approach to non-English speaking patients with substance use and developing pain contracts with patients.

This publication contains standardized patient training materials and post-case exercises for 3 cases. In addition, there are scoring rubrics for the post-case exercises and for the overall cases. Finally, there is a guide to debriefing the exercise with the residents and a resident evaluation of the exercise.

Screening, Brief Intervention and Referral to Treatment (SBIRT) has been promoted as model for improving healthcare delivery for patients with alcohol and substance use disorders. Brief interventions in primary care settings have been shown to reduce risky/harmful alcohol use (Whitlock EP, Polen MR, Green CA, Orleans T, Klein J. Behavioral counseling interventions in primary care to reduce risky/harmful alcohol use by adults: A summary of the evidence by the US Preventive Services Task Force. Ann Intern Med 2004;140:557-568.) and have been found to be one of the highest ranking preventive services in terms of cost-effectiveness (Solberg LI, Maciosek MV, Edwards NM. Primary care intervention to reduce alcohol misuse: ranking its health impact and cost effectiveness. Am J Prev Med 2008;34:143–152). Many have called for increased curricular content in medical schools and residency training on alcohol and substance use disorders. Effective tools need to be developed to assess the impact of these curricula and to assess resident competence in these skills. We developed three standardized patient cases and three post-case exercises to assess SBIRT skills in internal medicine residents. We have included the post-case exercises in these materials, but other may want to modify the post-case exercises based on their own curricular objectives.

Fifteen primary care internal medicine residents participated in the SP exercise (7 PGY2 and 8 PGY3). On average, residents received 79% of history points (SD=16) and 70% of information-sharing points (SD=12) for all three cases. Their average patient-physician interaction score was .69 (SD=0.06, 0=unacceptable, 1=outstanding). Averaging across all three cases, the residents received an overall satisfaction rating of 0.63 which ranked them slightly above “good”.

Residents reported that the standardized patient scenarios were representative of the patients they might see in clinic [mean = 3.67, SD = .98, (1 = strongly disagree, 5 = strongly agree)]. Most felt the learning experience was valuable (mean = 3.67, SD = 1.23) and would recommend the exercise to a fellow resident (mean = 3.60, SD = 1.24).

Residents reported highest levels of confidence in screening patients for alcohol (mean=3.73, 1=strongly disagree, 5=strongly agree) and drugs (mean=3.67), but felt less confident making a treatment plan for patients with substance use disorders (mean=3.13). During the semi-structured debrief session residents most commonly requested direct performance feedback and assistance in identifying ways to improve necessary skills.


Educational Objectives

  1. To assess primary care resident SBIRT skills.
  2. To screen for alcohol and substance use.
  3. To screen for mental illness.
  4. To take a substance use history.
  5. To provide accurate assessment of substance use disorders.
  6. To provide brief intervention to address substance use.
  7. To provide appropriate referral for patients with substance use disorders.
  8. To provide effective communication with patients regarding substance abuse.

Author Information

  • Maria Wamsley, MD: University of California, San Francisco, School of Medicine
  • Kathryn Treit, MD: University of California, San Francisco
  • Jason Satterfield, PhD: University of California, San Francisco
  • David Levitt: University of California, San Francisco
  • Elinore McCance-Katz, MD, PhD: University of California, San Francisco,
  • Gina Moreno-John, MD, MPH: University of California, San Francisco
  • Patricia O'Sullivan, MS, EdD: University of California, San Francisco
  • Sharon Parish, MD: Albert Einstein College of Medicine
  • Melissa Stein, MD: Albert Einstein College of Medicine

Disclosures
None to report.

Funding/Support
None to report.

Prior Presentations
Using Standardized Patients to Evaluate Resident Skills in Screening and Brief Interventions for Substance Abuse in the Primary Care Setting. Poster presented at: WGEA/WGSA Regional Conference; April 2011; Palo Alto, CA.

Using Standardized Patients to Evaluate Resident Skills in Screening and Brief Interventions for Substance Abuse in the Primary Care Setting. Poster presented at: SGIM National Meeting; May 2011; Phoenix, AZ.



Citation

Wamsley M, Treit K, Satterfield J, et al. Three standardized patient cases to measure screening, brief intervention and referral to treatment (SBIRT) skills in primary care residents. MedEdPORTAL. 2011;7:9005. https://doi.org/10.15766/mep_2374-8265.9005