MedElevator Войти в исследования
← Поиск публикаций

DOI 10.3791/72149

Медицинская библиотека · Journal of visualized experiments : JoVE · 2026

HeartFusion: A Cross-Modality Transformer for Accurate Cardiovascular Disease Diagnosis and Severity Assessment.

Ji Yingying, Hu Yu

СтатьяVideo-Audio MediaПеревод пока не подготовлен

Аннотация

Cardiovascular disease (CVD) requires diagnostic models that can integrate complementary electrophysiological and anatomical information while also representing ordered disease severity. HeartFusion was developed as a mathematically informed cross-modality Transformer framework combining electrocardiogram (ECG) and cardiac magnetic resonance imaging (MRI). Wavelet-derived ECG time-frequency representations were encoded with Cardioformer, MRI structure was encoded with TransUNet, and modality-specific embeddings were aligned in a shared latent space using cosine-similarity-based cross-modal attention. A transformer classifier performed diagnostic prediction, while an ordinal regression head modeled four ordered severity stages. Three controlled pseudo-paired benchmark cohorts were constructed from PTB-XL with ACDC (CVD-I), MIMIC-IV-ECG with CMRxRecon (CVD-II), and PTB-XL/MIMIC-IV-ECG with OCMR/Cardiac Atlas Project data (CVD-III). Source observations were partitioned before pseudo-pair construction to prevent cross-partition leakage, and five matched random seeds were used for evaluation. HeartFusion achieved diagnostic accuracies of 97.73%, 98.23%, and 98.02%, with AUC values of 98.12%, 98.76%, and 98.39% on CVD-I, CVD-II, and CVD-III, respectively. Severity staging achieved ordinal accuracies above 90%, with the best Cohen's kappa of 0.839 and MAE of 0.340. These findings support phenotype-level multimodal representation learning, while validation on genuinely patient-matched ECG-MRI cohorts remains necessary before clinical deployment.

Для цитирования: Ji Yingying, Hu Yu. HeartFusion: A Cross-Modality Transformer for Accurate Cardiovascular Disease Diagnosis and Severity Assessment.. Journal of visualized experiments : JoVE. 2026. DOI: 10.3791/72149.

Предметные рубрики MeSH

Подготовка и перевод публикации
Обработка статьи · этапы, ошибки и управление
Загрузка состояния…

История · было → стало

Состояние обновляется каждые 5 секунд, пока блок открыт. Процент показывается только там, где известен объём работы. Пауза останавливает продолжение этапа; текущий запрос к источнику может завершиться.

Тип публикации указан по данным источника. Уровень доказательности автоматически не присваивается.