MedElevator Войти в исследования
← Поиск публикаций

DOI 10.1007/s00590-025-04198-4

Медицинская библиотека · European journal of orthopaedic surgery & traumatology : orthopedie traumatologie · 2025

Evaluation of the reliability, usefulness, quality and readability of ChatGPT's responses on Scoliosis.

Çıracıoğlu Ayşe Merve, Dal Erdoğan Suheyla

СтатьяОценочное исследованиеПеревод в очереди

Аннотация

OBJECTIVE

This study evaluates the reliability, usefulness, quality, and readability of ChatGPT's responses to frequently asked questions about scoliosis.

METHODS

Sixteen frequently asked questions, identified through an analysis of Google Trends data and clinical feedback, were presented to ChatGPT for evaluation. Two independent experts assessed the responses using a 7-point Likert scale for reliability and usefulness. Additionally, the overall quality was also rated using the Global Quality Scale (GQS). To assess readability, various established metrics were employed, including the Flesch Reading Ease score (FRE), the Simple Measure of Gobbledygook (SMOG) Index, the Coleman-Liau Index (CLI), the Gunning Fog Index (GFI), the Flesch-Kinkaid Grade Level (FKGL), the FORCAST Grade Level, and the Automated Readability Index (ARI).

RESULTS

The mean reliability scores were 4.68 ± 0.73 (Median: 5, IQR 4-5), while the mean usefulness scores were 4.84 ± 0.84 (Median: 5, IQR 4-5). Additionally the mean GQS scores were 4.28 ± 0.58 (Median: 4, IQR 4-5). Inter-rater reliability analysis using the Intraclass correlation coefficient showed excellent agreement: 0.942 for reliability, 0.935 for usefulness, and 0.868 for GQS. While general informational questions received high scores, responses to treatment-specific and personalized inquiries required greater depth and comprehensiveness. Readability analysis indicated that ChatGPT's responses required at least a high school senior to college-level reading ability.

CONCLUSION

ChatGPT provides reliable, useful, and moderate quality information on scoliosis but has limitations in addressing treatment-specific and personalized inquiries. Caution is essential when using Artificial Intelligence (AI) in patient education and medical decision-making.

Для цитирования: Çıracıoğlu Ayşe Merve, Dal Erdoğan Suheyla. Evaluation of the reliability, usefulness, quality and readability of ChatGPT's responses on Scoliosis.. European journal of orthopaedic surgery & traumatology : orthopedie traumatologie. 2025. DOI: 10.1007/s00590-025-04198-4.

Предметные рубрики MeSH

Подготовка и перевод публикации
Обработка статьи · этапы, ошибки и управление
Загрузка состояния…

История · было → стало

Состояние обновляется каждые 5 секунд, пока блок открыт. Процент показывается только там, где известен объём работы. Пауза останавливает продолжение этапа; текущий запрос к источнику может завершиться.

Тип публикации указан по данным источника. Уровень доказательности автоматически не присваивается.