Validation of a test of competence in transesophageal echocardiography.

OBJECTIVE

A test was developed that is based on intraoperative findings to evaluate knowledge of intraoperative echocardiography. This study examines the performance of attending anesthesiologists and residents at various levels of training in order to validate the test's ability to measure physician competence in intraoperative echocardiographic diagnosis.

DESIGN

This study was a prospective evaluation of a test of competence in transesophageal echocardiography.

SETTING

Two university medical centers.

PARTICIPANTS

Volunteer anesthesia faculty and residents.

INTERVENTIONS: The participants took an echocardiographic examination that consisted of 34 "K"-type multiple-choice questions and a 45-second video-loop sequence for each question. The video sequences were chosen for their high quality and unambiguous representation of both normal and pathologic images obtained by transverse transesophageal echocardiographic imaging. The questions were written by experienced echocardiographers. The test was administered to 25 individuals at two academic institutions: 11 residents with minimal transesophageal echocardiography exposure and 14 faculty who were relatively experienced with transesophageal echocardiography. All of the residents repeated the examination at the end of their third clinical anesthesia year, which included transesophageal echocardiography training. The differences between the groups' scores were analyzed using the Kruskal-Wallis test and Wilcoxon's rank-sum test. To correct for the multiple comparisons, p < 0.025 was deemed significant. MEASUREMENTS AND MAIN RESULTS. Before their transesophageal echocardiography training, the residents scored significantly lower than the faculty (p < 0.002). After 1 year of training, their scores significantly increased (p = 0.021), and their scores were not significantly different from the faculty level (p = 0.052).

CONCLUSIONS

Test performance differed according to level of experience. This suggests that the test is a valid measure of intraoperative transesophageal echocardiography competence.