The effect of defined violations of test security on admissions outcomes using multiple mini-interviews.

INTRODUCTION

Heterogeneous results exist regarding the impact of security violations on student performances in objective structured clinical examinations (OSCEs). Three separate studies investigate whether anticipated security violations result in undesirable enhancement of MMI performance ratings.

METHODS

Study 1: low-stakes: MMI station stems provided to a random half of 57 medical school applicants 2 weeks in advance of participation in a research study. Study 2: high-stakes: 384 medical school applicants sat a 12-station MMI to determine admission. Each half received 1 of 2 pilot MMI station stems 2 weeks in advance. Study 3: high-stakes: 38 interviewees with dual applications to occupational therapy and physiotherapy experienced the same 7-station MMI twice on the same date.

RESULTS

No statistically significant differences in MMI performances were detected.

CONCLUSIONS

Predictable violations of MMI security do not unduly influence applicant performance ratings.