Cross-modal fusion of OCT and OCT angiography enface for improved diagnostics of diabetic retinopathy.

INTRODUCTION

Diabetic retinopathy (DR) is a leading cause of vision impairment worldwide, highlighting the need for accurate and accessible screening tools. Optical Coherence Tomography (OCT) provides high-resolution structural information of the retina, whereas OCT angiography (OCTA) offers complementary vascular information that is highly relevant for DR diagnosis.

METHODS

In this study, we propose a cross-modal fusion of OCT B-scans with single-channel enface OCTA using a bidirectional cross-modal attention network for automated DR classification. Two independent datasets, OCT500 and UIC, comprising 730 scans in total, were utilized to evaluate performance in within-dataset, combined-dataset, and cross-dataset generalization settings. A ConvNeXt V2 Large model trained solely on OCT images served as the unimodal baseline. In addition to ground-truth (GT) OCTA, we explored the use of translated (TR) OCTA generated from OCT scans, eliminating the requirement for dedicated OCTA hardware.

RESULTS

Experimental results demonstrated that cross-modal fusion consistently outperformed unimodal OCT classification across all evaluation scenarios. Fusion with GT OCTA improved classification accuracy and discriminative performance, while TR OCTA achieved comparable or superior results in most settings. Furthermore, TR OCTA improved sensitivity and cross-dataset generalization, indicating enhanced robustness to domain shifts.

DISCUSSION: These findings demonstrate that attention-based OCTOCTA enface fusion provides clinically meaningful improvements for DR detection and suggest that computationally generated OCTA can serve as a practical, low-cost alternative to hardware-acquired OCTA, enabling broader deployment of high-performance retinal screening systems in resource-limited clinical environments.