DOI 10.1038/s41598-026-54859-5
SDEF-BEV: spatial-aware dual-expert radar-camera fusion for robust BEV 3D object detection.
Аннотация
Bird's-eye view (BEV) radar-camera fusion is an economical and robust solution for 3D perception in autonomous driving. However, existing methods struggle with spatial misalignment between modalities and lack the ability to dynamically adjust the contribution of each modality across different spatial regions in complex scenarios. To address these issues, we propose SDEF-BEV, a novel spatial-aware dual-expert fusion network. At its core, SDEF-BEV adopts a parallel dual-path fusion architecture. The Spatial-Aware Dual-Expert Fusion (SDEF) module adaptively learns optimal feature fusion strategies via two specialized experts (semantic-enhanced and geometry-enhanced) and a spatial gating network, generating location-wise fusion weights. Meanwhile, a parallel Channel and Spatial Fusion (CSF) path preserves rich spatial context through convolutional inductive biases. The outputs of these two paths are aggregated to form unified and information-rich fused features. Experiments on the nuScenes dataset demonstrate that SDEF-BEV achieves an NDS of 57.1% and an mAP of 45.7%, showing competitive performance. Extensive ablation studies further validate the effectiveness of the parallel SDEF architecture, and the overall approach exhibits strong robustness, particularly under challenging adverse weather conditions.
Подготовка и перевод публикации
Обработка статьи · этапы, ошибки и управление
Ошибки и ограничения
История · было → стало
Состояние обновляется каждые 5 секунд, пока блок открыт. Процент показывается только там, где известен объём работы. Пауза останавливает продолжение этапа; текущий запрос к источнику может завершиться.
Тип публикации указан по данным источника. Уровень доказательности автоматически не присваивается.