medRxiv : the preprint server for health sciences · 2026
Differentiating nonfluent/agrammatic and logopenic primary progressive aphasia in Catalan-Spanish bilinguals by applying multilingual multimodal machine learning (M³L) to connected speech.
СтатьяПрепринтНазвание и аннотация: Перевод в очереди
Обработка статьи · этапы, ошибки и управление
Загрузка состояния…
Ошибки и ограничения
История · было → стало
Состояние обновляется каждые 5 секунд, пока блок открыт. Процент показывается только там, где известен объём работы. Пауза останавливает продолжение этапа; текущий запрос к источнику может завершиться.
Pugalenthi Lokesha S, Collins Andrew P, Colomer Núria Montagut, Marqués-Kiderle Sonia-Karin, Rodriguez Camille Wagner, Chaires Jan Christian Holst, Motta Whendy Avila, Filella-Mercè Júlia, Li Junyi Jessy, Llanos Fernando, Zhu Nuole, Rubio-Guerra Sara, Illan-Gala Ignacio, Borrego-Écija Sergi, Lladó Albert, Fortea Juan, Lleó Alberto, Sánchez-Valle Raquel, Henry Maya L, Santos Miguel Ángel Santos, Grasso Stephanie M
Аннотация
BACKGROUND: The nonfluent/agrammatic (nfv) and logopenic (lv) variants of primary progressive aphasia (PPA) disrupt fluency through distinct underlying neurocognitive mechanisms. Differential diagnosis currently requires hours of cognitive-linguistic testing, with additional barriers for bilingual patients due to a shortage of bilingual service providers and a lack of well-established assessment methods. In English speakers, a promising automated approach for differentiating nfvPPA and lvPPA is to derive speech-timing measures and linguistic features from connected speech as input to machine learning (ML) classification algorithms. To our knowledge, this approach has not been evaluated in the context of bilingualism.
METHODS: Thirty-four Catalan-Spanish simultaneous bilingual patients (lv = 24, nfv = 10) were asked to describe a picture (Western Aphasia Battery Picnic Scene) in both their dominant and non-dominant language. From the participant's recorded response, we derived four feature sets: speech-timing measures, derived with PRAAT; word-level parameters, derived from corpora; linguistic features, derived with the natural language processing tools SpaCy and CLAN; image-text congruence scores, derived with the vision-language encoder Multilingual-CLIP. Each feature set was fed into classification algorithms for differentiating nfv from lv in participants' non-dominant and dominant samples. Then, we combined each feature set's classifier into an ensemble model. We used the McNemar test to determine the statistical significance of differences in classification performance between responses in the non-dominant and dominant language.
RESULTS: The best-performing classifier achieved F1 macro scores of 93% (word-level parameters) and 92% (ensemble) in the non-dominant and dominant language, respectively. For all feature sets and ensemble models, classification performance did not significantly differ between the non-dominant and dominant language. Ensemble modeling did not significantly improve classification performance in either language.
CONCLUSIONS: Taking advantage of recent advances in multilingual multimodal machine learning, we accurately differentiate Spanish-Catalan bilingual individuals with nfvPPA and lvPPA using a largely automated, time-efficient (1-2 minutes), and ecologically valid connected-speech-based approach. Future directions include evaluating this approach on larger datasets balanced by PPA subtype, using automated transcriptions of connected speech. Our study represents a step towards addressing current inequities in PPA differential diagnosis for non-English-speaking bilingual speakers.
TRIAL REGISTRATION: Data from the clinical trial NCT05741853 was retrospectively analyzed.
METHODS: Thirty-four Catalan-Spanish simultaneous bilingual patients (lv = 24, nfv = 10) were asked to describe a picture (Western Aphasia Battery Picnic Scene) in both their dominant and non-dominant language. From the participant's recorded response, we derived four feature sets: speech-timing measures, derived with PRAAT; word-level parameters, derived from corpora; linguistic features, derived with the natural language processing tools SpaCy and CLAN; image-text congruence scores, derived with the vision-language encoder Multilingual-CLIP. Each feature set was fed into classification algorithms for differentiating nfv from lv in participants' non-dominant and dominant samples. Then, we combined each feature set's classifier into an ensemble model. We used the McNemar test to determine the statistical significance of differences in classification performance between responses in the non-dominant and dominant language.
RESULTS: The best-performing classifier achieved F1 macro scores of 93% (word-level parameters) and 92% (ensemble) in the non-dominant and dominant language, respectively. For all feature sets and ensemble models, classification performance did not significantly differ between the non-dominant and dominant language. Ensemble modeling did not significantly improve classification performance in either language.
CONCLUSIONS: Taking advantage of recent advances in multilingual multimodal machine learning, we accurately differentiate Spanish-Catalan bilingual individuals with nfvPPA and lvPPA using a largely automated, time-efficient (1-2 minutes), and ecologically valid connected-speech-based approach. Future directions include evaluating this approach on larger datasets balanced by PPA subtype, using automated transcriptions of connected speech. Our study represents a step towards addressing current inequities in PPA differential diagnosis for non-English-speaking bilingual speakers.
TRIAL REGISTRATION: Data from the clinical trial NCT05741853 was retrospectively analyzed.