Journal of evaluation in clinical practice · 2026
Comparison of Natural Language Processing and Traditional Qualitative Analyses of Caregiver Feedback From a Community-Based Intervention for Children With Autism.
Сравнительное исследованиеСтатьяНаблюдательное исследованиеНазвание и аннотация: Перевод пока не подготовлен
Обработка статьи · этапы, ошибки и управление
Загрузка состояния…
Ошибки и ограничения
История · было → стало
Состояние обновляется каждые 5 секунд, пока блок открыт. Процент показывается только там, где известен объём работы. Пауза останавливает продолжение этапа; текущий запрос к источнику может завершиться.
Caruthers Carmen, Hochheimer Samantha, Pellecchia Melanie, Gulsrud Amanda, Hassrick Elizabeth McGhee, Mandell David, Stahmer Aubyn, Kasari Connie, Iadarola Suzannah
Аннотация
BACKGROUND: Satisfaction data is a commonly used construct to evaluate programs, products, and experiences. This data is collected through forced choice (scales, surveys) and/or open-ended measures. While open-ended questions have the greatest potential for more useful and candid feedback, analysis of this data can be time-consuming.
OBJECTIVE: This paper compares two evaluation methods, traditional qualitative analysis (TQA) and Natural Language Processing (NLP), to analyze themes from open-ended satisfaction data of a caregiver-mediated intervention for families of autistic children, called 'Mind the Gap (MTG)'.
METHODS: This secondary analysis utilized existing survey data from 73 caregivers that participated in the MTG trial. To identify themes, TQA was performed using latent coding, and R statistical software was used for NLP, with strategies including term frequency and sentiment analysis. Methods were evaluated independently and in combination.
RESULTS AND CONCLUSION: Both methods are comparable in thoroughly analysing this type of data, with each method contributing both unique and overlapping themes. TQA and NLP showed parent satisfaction with materials and organization, as well as peer coach support. NLP may provide more thorough results while also reducing the time burden associated with TQA, although this strategy may also overlook important nuance in data. This clinical trial is registered as 'Mind the Gap (AIRB-3) (MTG)' at clinicaltrials.gov, registration number NCT03711799.
OBJECTIVE: This paper compares two evaluation methods, traditional qualitative analysis (TQA) and Natural Language Processing (NLP), to analyze themes from open-ended satisfaction data of a caregiver-mediated intervention for families of autistic children, called 'Mind the Gap (MTG)'.
METHODS: This secondary analysis utilized existing survey data from 73 caregivers that participated in the MTG trial. To identify themes, TQA was performed using latent coding, and R statistical software was used for NLP, with strategies including term frequency and sentiment analysis. Methods were evaluated independently and in combination.
RESULTS AND CONCLUSION: Both methods are comparable in thoroughly analysing this type of data, with each method contributing both unique and overlapping themes. TQA and NLP showed parent satisfaction with materials and organization, as well as peer coach support. NLP may provide more thorough results while also reducing the time burden associated with TQA, although this strategy may also overlook important nuance in data. This clinical trial is registered as 'Mind the Gap (AIRB-3) (MTG)' at clinicaltrials.gov, registration number NCT03711799.