MedElevator Войти в исследования
← Поиск публикаций

DOI 10.1097/bpo.0000000000002065

Медицинская библиотека · Journal of pediatric orthopedics · 2022

Interobserver Variability of Hip Dysplasia Indices on Sweep Ultrasound for Novices, Experts, and Artificial Intelligence.

Ghasseminia Siyavash, Lim Andrew Kean Seng, Concepcion Nathan D P, Kirschner David, Teo Yi Ming, Dulai Sukhdeep, Mabee Myles, Kernick Sara, Brockley Cain, Muljadi Siska, Singh Pavel, Rakkunedeth Hareendranathan Abhilash, Kapur Jeevesh, Zonoobi Dornoosh, Punithakumar Kumaradevan, Jaremko Jacob L

СтатьяПеревод в очереди

Аннотация

BACKGROUND

Ultrasound for developmental dysplasia of the hip (DDH) is challenging for nonexperts to perform and interpret. Recording "sweep" images allows more complete hip assessment, suitable for automation by artificial intelligence (AI), but reliability has not been established. We assessed agreement between readers of varying experience and a commercial AI algorithm, in DDH detection from infant hip ultrasound sweeps.

METHODS

We selected a full spectrum of poor-to-excellent quality images and normal to severe dysplasia, in 240 hips (120 single 2-dimensional images, 120 sweeps). For 12 readers (radiologists, sonographers, clinicians and researchers; 3 were DDH subspecialists), and a ultrasound-FDA-cleared AI software package (Medo Hip), we calculated interobserver reliability for alpha angle measurements by intraclass correlation coefficient (ICC2,1) and for DDH classification by Randolph Kappa.

RESULTS

Alpha angle reliability was high for AI versus subspecialists (ICC=0.87 for sweeps, 0.90 for single images). For DDH diagnosis from sweeps, agreement was high between subspecialists (kappa=0.72), and moderate for nonsubspecialists (0.54) and AI (0.47). Agreement was higher for single images (kappa=0.80, 0.66, 0.49). AI reliability deteriorated more than human readers for the poorest-quality images. The agreement of radiologists and clinicians with the accepted standard, while still high, was significantly poorer for sweeps than 2D images (P<0.05).

CONCLUSIONS

In a challenging exercise representing the wide spectrum of image quality and reader experience seen in real-world hip ultrasound, agreement on DDH diagnosis from easily obtained sweeps was only slightly lower than from single images, likely because of the additional step of selecting the best image. AI performed similarly to a nonsubspecialist human reader but was more affected by low-quality images.

Для цитирования: Ghasseminia Siyavash, Lim Andrew Kean Seng, Concepcion Nathan D P, Kirschner David, Teo Yi Ming, Dulai Sukhdeep, Mabee Myles, Kernick Sara, Brockley Cain, Muljadi Siska, Singh Pavel, Rakkunedeth Hareendranathan Abhilash, Kapur Jeevesh, Zonoobi Dornoosh, Punithakumar Kumaradevan, Jaremko Jacob L. Interobserver Variability of Hip Dysplasia Indices on Sweep Ultrasound for Novices, Experts, and Artificial Intelligence.. Journal of pediatric orthopedics. 2022. DOI: 10.1097/bpo.0000000000002065.

Предметные рубрики MeSH

Подготовка и перевод публикации
Обработка статьи · этапы, ошибки и управление
Загрузка состояния…

История · было → стало

Состояние обновляется каждые 5 секунд, пока блок открыт. Процент показывается только там, где известен объём работы. Пауза останавливает продолжение этапа; текущий запрос к источнику может завершиться.

Тип публикации указан по данным источника. Уровень доказательности автоматически не присваивается.