MedElevator Войти в исследования
← Поиск публикаций

DOI 10.3389/fnins.2023.1351848

Медицинская библиотека · Frontiers in neuroscience · 2024

Speaker-turn aware diarization for speech-based cognitive assessments.

Xu Sean Shensheng, Ke Xiaoquan, Mak Man-Wai, Wong Ka Ho, Meng Helen, Kwok Timothy C Y, Gu Jason, Zhang Jian, Tao Wei, Chang Chunqi

СтатьяПеревод в очереди

Аннотация

INTRODUCTION

Speaker diarization is an essential preprocessing step for diagnosing cognitive impairments from speech-based Montreal cognitive assessments (MoCA).

METHODS

This paper proposes three enhancements to the conventional speaker diarization methods for such assessments. The enhancements tackle the challenges of diarizing MoCA recordings on two fronts. First, multi-scale channel interdependence speaker embedding is used as the front-end speaker representation for overcoming the acoustic mismatch caused by far-field microphones. Specifically, a squeeze-and-excitation (SE) unit and channel-dependent attention are added to Res2Net blocks for multi-scale feature aggregation. Second, a sequence comparison approach with a holistic view of the whole conversation is applied to measure the similarity of short speech segments in the conversation, which results in a speaker-turn aware scoring matrix for the subsequent clustering step. Third, to further enhance the diarization performance, we propose incorporating a pairwise similarity measure so that the speaker-turn aware scoring matrix contains both local and global information across the segments.

RESULTS

Evaluations on an interactive MoCA dataset show that the proposed enhancements lead to a diarization system that outperforms the conventional x-vector/PLDA systems under language-, age-, and microphone-mismatch scenarios.

DISCUSSION: The results also show that the proposed enhancements can help hypothesize the speaker-turn timestamps, making the diarization method amendable to datasets without timestamp information.

Для цитирования: Xu Sean Shensheng, Ke Xiaoquan, Mak Man-Wai, Wong Ka Ho, Meng Helen, Kwok Timothy C Y, Gu Jason, Zhang Jian, Tao Wei, Chang Chunqi. Speaker-turn aware diarization for speech-based cognitive assessments.. Frontiers in neuroscience. 2024. DOI: 10.3389/fnins.2023.1351848.
Подготовка и перевод публикации
Обработка статьи · этапы, ошибки и управление
Загрузка состояния…

История · было → стало

Состояние обновляется каждые 5 секунд, пока блок открыт. Процент показывается только там, где известен объём работы. Пауза останавливает продолжение этапа; текущий запрос к источнику может завершиться.

Тип публикации указан по данным источника. Уровень доказательности автоматически не присваивается.