Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society · 2025
Unsatisfactory Accuracy and Inconsistent Inter-Rater Reliability Among Electroencephalographers in Identifying Epileptic Spasms.
СтатьяНазвание и аннотация: Перевод пока не подготовлен
Обработка статьи · этапы, ошибки и управление
Загрузка состояния…
Ошибки и ограничения
История · было → стало
Состояние обновляется каждые 5 секунд, пока блок открыт. Процент показывается только там, где известен объём работы. Пауза останавливает продолжение этапа; текущий запрос к источнику может завершиться.
Wang Wen, Wan Lin, Chen Jian, Zhao Yan, Wang Zong, Fan Yuying, Lu Guangshuang, Wang Hongjie, Liu Tong, Cheng Weike, Xu Yang, Zhang Yuan, Zhang Bo, Fu Lijun, Yang Guang
Аннотация
PURPOSE: It is widely believed that electroencephalographers can identify epileptic spasms (ES) accurately. However, additional research is needed to verify this assumption, especially because some ES can be subtle, involving only facial movements, such as eye rolling.
METHODS: The EEG data of 22 patients diagnosed with ES (whether or not it is diagnosed as infantile epileptic spasm syndrome) were evaluated by 6 senior electroencephalographers. The content included judgments of the presence or absence of ES throughout the entire examination process for each patient and in segmented pages every 4 seconds and the consistency among electroencephalographers. The inter-rater reliability (IRR) was assessed using the Fleiss kappa statistic.
RESULTS: The accuracy of the 6 evaluators for identifying patients with or without ES in the 22-patient data set was 0.727 to 0.90, and the IRR among the 6 raters was moderate (0.45). Moderate IRR was observed among evaluators from tertiary (0.425), and poor IRR was observed among evaluators from nontertiary (0.399) centers. For the 4-second segmented pages, the accuracy for identifying ES in the 22 patients by the 6 evaluators was 0.943 to 1, and the IRR among the 6 evaluators was good agreement (0.63).
CONCLUSIONS: Omissions in the identification of ES episodes were noted among different electroencephalographers, and IRR regarding whether a patient experienced an ES or whether a single event constituted an ES was found to be unsatisfactory. Identifying ES remains challenging for even experienced electroencephalographers.
METHODS: The EEG data of 22 patients diagnosed with ES (whether or not it is diagnosed as infantile epileptic spasm syndrome) were evaluated by 6 senior electroencephalographers. The content included judgments of the presence or absence of ES throughout the entire examination process for each patient and in segmented pages every 4 seconds and the consistency among electroencephalographers. The inter-rater reliability (IRR) was assessed using the Fleiss kappa statistic.
RESULTS: The accuracy of the 6 evaluators for identifying patients with or without ES in the 22-patient data set was 0.727 to 0.90, and the IRR among the 6 raters was moderate (0.45). Moderate IRR was observed among evaluators from tertiary (0.425), and poor IRR was observed among evaluators from nontertiary (0.399) centers. For the 4-second segmented pages, the accuracy for identifying ES in the 22 patients by the 6 evaluators was 0.943 to 1, and the IRR among the 6 evaluators was good agreement (0.63).
CONCLUSIONS: Omissions in the identification of ES episodes were noted among different electroencephalographers, and IRR regarding whether a patient experienced an ES or whether a single event constituted an ES was found to be unsatisfactory. Identifying ES remains challenging for even experienced electroencephalographers.