International journal of computer assisted radiology and surgery · 2026
Multi-modal monocular endoscopic depth and pose estimation with edge-guided self-supervision.
СтатьяНазвание и аннотация: Перевод пока не подготовлен
Обработка статьи · этапы, ошибки и управление
Загрузка состояния…
Ошибки и ограничения
История · было → стало
Состояние обновляется каждые 5 секунд, пока блок открыт. Процент показывается только там, где известен объём работы. Пауза останавливает продолжение этапа; текущий запрос к источнику может завершиться.
Ju Xinwei, Daher Rema, Stoyanov Danail, Bano Sophia, Vasconcelos Francisco
Аннотация
PURPOSE: Monocular depth and pose estimation play an essential role in developing colonoscopy-assisted navigation systems. Accurate geometric understanding can reduce blind spots, lower the risk of missed or recurrent lesions, and prevent incomplete examinations. However, this task remains challenging due to texture-less surfaces, complex illumination, tissue deformation, and the scarcity of in-vivo datasets with reliable ground truth.
METHODS: We propose a self-supervised learning framework that leverages anatomical and illumination priors to guide geometric learning. The framework integrates two complementary cues: (1) edge maps, obtained from a learning-based detector trained to capture thin and high-frequency mucosal boundaries, and (2) luminance decomposition, produced through intrinsic image separation that isolates shading from reflectance. These modalities provide structural and photometric guidance to the pose and depth networks, with an edge-guided loss applied in a stage-wise refinement that enhances motion alignment while preserving depth consistency.
RESULTS: Experiments on phantom (C3VD) and real (EndoMapper) datasets demonstrate state-of-the-art performance in depth estimation and competitive accuracy in pose estimation. Ablation analyses further evaluate the influence of training domain, temporal sampling, and supervision type. Two practical findings emerge: Self-supervised training on real data outperforms supervised training on phantom data, highlighting the importance of domain realism; and dataset-specific frame-rate sampling is critical for generating effective training sequences.
CONCLUSION: The proposed framework enhances geometric learning in endoscopic videos by incorporating structure- and illumination-aware cues, providing a robust foundation for reliable, marker-free colonoscopy navigation. The code and pretrained models are publicly available at: https://github.com/XinweiJu/PRISM .
METHODS: We propose a self-supervised learning framework that leverages anatomical and illumination priors to guide geometric learning. The framework integrates two complementary cues: (1) edge maps, obtained from a learning-based detector trained to capture thin and high-frequency mucosal boundaries, and (2) luminance decomposition, produced through intrinsic image separation that isolates shading from reflectance. These modalities provide structural and photometric guidance to the pose and depth networks, with an edge-guided loss applied in a stage-wise refinement that enhances motion alignment while preserving depth consistency.
RESULTS: Experiments on phantom (C3VD) and real (EndoMapper) datasets demonstrate state-of-the-art performance in depth estimation and competitive accuracy in pose estimation. Ablation analyses further evaluate the influence of training domain, temporal sampling, and supervision type. Two practical findings emerge: Self-supervised training on real data outperforms supervised training on phantom data, highlighting the importance of domain realism; and dataset-specific frame-rate sampling is critical for generating effective training sequences.
CONCLUSION: The proposed framework enhances geometric learning in endoscopic videos by incorporating structure- and illumination-aware cues, providing a robust foundation for reliable, marker-free colonoscopy navigation. The code and pretrained models are publicly available at: https://github.com/XinweiJu/PRISM .