Cirugia y cirujanos · 2026
Accuracy and limitations of artificial intelligence chatbots in answering patient questions on scoliosis surgery.
СтатьяНазвание и аннотация: Перевод в очереди
Обработка статьи · этапы, ошибки и управление
Загрузка состояния…
Ошибки и ограничения
История · было → стало
Состояние обновляется каждые 5 секунд, пока блок открыт. Процент показывается только там, где известен объём работы. Пауза останавливает продолжение этапа; текущий запрос к источнику может завершиться.
Alibakan Güngör, Sülek Yusuf
Аннотация
OBJECTIVE: The aim of this study was to analyze the accuracy, reliability, and quality of the content of responses provided by artificial intelligence (AI)-based chatbots to frequently asked questions related to scoliosis surgery.
METHODS: A set of 25 questions related to diagnosis, treatment options, surgical risks, and recovery was developed based on clinical experience. The responses were anonymized and evaluated by two orthopedic surgeons using a 4-point scale to rate accuracy, clarity, and consistency. Cohen's kappa coefficient was used for interrater reliability, and the Kruskal-Wallis test was used for statistical analysis.
RESULTS: ChatGPT 4o performed best, with 60% of responses rated as excellent. Gemini Advanced 1.5 Pro followed with 56%, while Microsoft Copilot performed poorly, with 76% of responses requiring moderate clarification. The differences between the chatbots were statistically significant (p < 0.001). ChatGPT 4o and Gemini did not differ significantly from each other (p = 0.850), but both outperformed Copilot (p < 0.001).
CONCLUSIONS: AI chatbots show great potential for patient education in scoliosis surgery. ChatGPT 4o was the most effective, although complex queries still require medical supervision.
METHODS: A set of 25 questions related to diagnosis, treatment options, surgical risks, and recovery was developed based on clinical experience. The responses were anonymized and evaluated by two orthopedic surgeons using a 4-point scale to rate accuracy, clarity, and consistency. Cohen's kappa coefficient was used for interrater reliability, and the Kruskal-Wallis test was used for statistical analysis.
RESULTS: ChatGPT 4o performed best, with 60% of responses rated as excellent. Gemini Advanced 1.5 Pro followed with 56%, while Microsoft Copilot performed poorly, with 76% of responses requiring moderate clarification. The differences between the chatbots were statistically significant (p < 0.001). ChatGPT 4o and Gemini did not differ significantly from each other (p = 0.850), but both outperformed Copilot (p < 0.001).
CONCLUSIONS: AI chatbots show great potential for patient education in scoliosis surgery. ChatGPT 4o was the most effective, although complex queries still require medical supervision.