Medical & biological engineering & computing · 2026
Lumina-Net: temporal learning with feature fusion for endoscopic artifact removal.
СтатьяНазвание и аннотация: Перевод в очереди
Обработка статьи · этапы, ошибки и управление
Загрузка состояния…
Ошибки и ограничения
История · было → стало
Состояние обновляется каждые 5 секунд, пока блок открыт. Процент показывается только там, где известен объём работы. Пауза останавливает продолжение этапа; текущий запрос к источнику может завершиться.
Yang Tianjun, Xu Xingfeng, Chen Xin, Zuo Siyang
Аннотация
Gastrointestinal (GI) endoscopy is widely used for diagnosis and minimally invasive therapy, yet specular reflections frequently saturate tissue appearance and introduce temporal flicker, degrading both clinical inspection and downstream computational analysis. This study proposes Lumina-Net, a mask-guided video inpainting framework whose spatiotemporal Transformer with overlapping tokens aggregates complementary information across consecutive frames. The decoder incorporates two lightweight modules: Variance-Guided Feature Modulation (VGFM), which recalibrates features using channel statistics to handle mixed-scale specular highlights, and a parameter-free Multi-Scale Energy Free-Space Attention (MS-EFSA) mechanism that derives spatial weights from feature energy to preserve mucosal structures. On the HyperKvasir and GastroHUN datasets, Lumina-Net achieves a peak signal-to-noise ratio (PSNR) of 30.20 dB and reduces the mean squared error (MSE) by approximately 5.3% compared with the strongest baseline, while running at 27 frames per second (FPS) on a single GPU. In a blinded evaluation, clinical experts consistently prefer the visual quality of the proposed method, and improved monocular depth estimation on processed sequences further demonstrates downstream utility. These results indicate that Lumina-Net provides temporally stable specular reflection removal for reliable clinical observation and downstream tasks such as robotic-assisted intervention.