Pilot study of an Objective Structured Clinical Examination ("the Six Pack") for evaluating clinical competencies.

OBJECTIVE

The purpose of this study was to evaluate an Objective Structured Clinical Examination (OSCE) designed to examine all six competencies and provide meaningful results to improve resident performance.

STUDY

DESIGN

A prospective, observational study.

METHODS

The OSCE consists of 1 hour for examination of a simulated patient, documentation, and feedback, with 30 minutes for an evidence-based medicine (EBM) test. Eight otolaryngology residents participated. Digital recordings and written documentation were evaluated on all competencies except practice-based learning. An EBM test was scored to assess practice-based learning.

RESULTS

Overall, senior residents scored better. Seniors scored better on performing a focused history, whereas juniors scored better for thoroughness. Seniors coded better than juniors, although seniors tended to undercode and juniors tended to overcode. Two cases of "insurance fraud" were also discovered.

CONCLUSIONS

The "Six Pack" successfully evaluated all competencies while providing valuable information. A clinical practicum was added to improve history and physical examination skills. The discussion of coding and a billing seminar also resulted. Residents believed the OSCE was valuable. Faculty members were impressed with the useful information obtained.