A Randomized Controlled Pilot Study Comparing ChatGPT to Live Coaching Deliberate Practice to Teach Difficult Conversations.

BACKGROUND

Poor performance during difficult conversations is associated with decreased patient satisfaction and increased clinician burnout. Communication skills can be taught using simulated patients (SPs), but this approach is resource intensive. Artificial intelligence (AI) has emerged as a potential adjunct for communication training. However, its role within anesthesiology education and structured communication curricula remains unclear.

METHODS

We conducted a randomized controlled pilot study involving anesthesiology trainees, including anesthesiology residents and student registered nurse anesthetists, at a tertiary pediatric hospital. All participants completed a didactic session on the SPIKES framework, followed by deliberate practice using either OpenAI's ChatGPT or an SP with live instructor feedback. Participants completed pretraining and posttraining assessments using a validated 16-item communication skills checklist with an SP. Self-reported knowledge, confidence, and ability to apply communication skills were assessed using Likert-scale surveys.

RESULTS

Twenty-five trainees were enrolled (ChatGPT n = 13; SP n = 12). Both groups demonstrated significant improvements in checklist scores following training. Self-reported knowledge, confidence, and application of communication skills improved in both groups.

CONCLUSIONS

A curriculum combining didactic instruction with deliberate practice using either ChatGPT or SPs was associated with improved simulated communication performance among anesthesiology trainees. This pilot study demonstrates the feasibility of incorporating AI-based tools into communication training.