MedElevator Войти в исследования
← Поиск публикаций

DOI 10.3791/73434

Медицинская библиотека · Journal of visualized experiments : JoVE · 2026

Tri-Stream Disentangled Network with Adaptive Dual-Space Fusion for Electroencephalography-Based Image Reconstruction on THINGS-EEG2.

Zhou Yipeng, Li Jingyuan, Zhao Kaizhong, Zhu Hong, Zhu Lin, Jiang Huan, Zhang Qingchuan

СтатьяVideo-Audio MediaПеревод пока не подготовлен

Аннотация

Reconstructing visual stimuli from non-invasive electroencephalography (EEG) requires mapping short, noisy neural responses to meaningful visual representations despite limited spatial sampling. Existing EEG-to-image approaches employ diverse neural representations and generative strategies, necessitating reproducible workflows that disentangle structural and semantic contributions. This protocol presents the Tri-stream Disentangled Network (TDE-Net), a computational framework for EEG-based image reconstruction. The protocol uses preprocessed THINGS-EEG2 recordings and organizes EEG information into a raw EEG anchor, a sample-specific functional graph stream, and a multi-scale temporal semantic stream. The graph stream captures frequency-domain relationships among EEG channels via graph convolution and cross-trial contrastive learning, while the semantic stream extracts task-relevant features via adaptive spatial weighting and multi-scale temporal convolutions. Structural and semantic features are mapped separately to variational autoencoder (VAE) and Contrastive Language-Image Pre-training (CLIP) latent spaces, combined using development-set-selected fusion weights, and decoded using Stable UnCLIP. Across 10 participants, TDE-Net achieved a mean CLIP pairwise identification accuracy of 0.8135, with complementary metrics demonstrating structural and feature-space correspondence. Ablation and representation-level analyses further characterized the contributions of individual streams. This protocol provides a reproducible framework for investigating complementary EEG representations and diffusion-based visual reconstruction.

Для цитирования: Zhou Yipeng, Li Jingyuan, Zhao Kaizhong, Zhu Hong, Zhu Lin, Jiang Huan, Zhang Qingchuan. Tri-Stream Disentangled Network with Adaptive Dual-Space Fusion for Electroencephalography-Based Image Reconstruction on THINGS-EEG2.. Journal of visualized experiments : JoVE. 2026. DOI: 10.3791/73434.

Предметные рубрики MeSH

Подготовка и перевод публикации
Обработка статьи · этапы, ошибки и управление
Загрузка состояния…

История · было → стало

Состояние обновляется каждые 5 секунд, пока блок открыт. Процент показывается только там, где известен объём работы. Пауза останавливает продолжение этапа; текущий запрос к источнику может завершиться.

Тип публикации указан по данным источника. Уровень доказательности автоматически не присваивается.