MedElevator Войти в исследования
← Поиск публикаций

DOI 10.1109/tip.2026.3736818

Медицинская библиотека · IEEE transactions on image processing : a publication of the IEEE Signal Processing Society · 2026

AdaCompVL: Adaptive Compression of Spatiotemporal and Cross-Modal Redundancy for Efficient Video-Language Learning.

Ma Jianxin, Jin Shibo, Dang Lujuan, Chen Liangjun, Chen Badong

СтатьяПеревод в очереди

Аннотация

Multimodal large language models (MLLMs) have recently extended from static image understanding to video comprehension, but representing videos as frame-level token sequences incurs substantial computational overhead. Existing visual token compression methods typically rely on uniform sampling or single-dimension redundancy modeling, making them less effective across diverse scene dynamics and textual inputs. To address this issue, we propose AdaCompVL (Adaptive Compression for Video-Language), a training-free adaptive compression framework that considers both scene dynamics and semantic relevance to efficiently reduce redundant visual tokens. Specifically, we introduce a dynamic-aware switching mechanism that leverages adjacent-frame similarity to distinguish between low-and high-dynamic scenarios. For low-dynamic scenes, temporal redundancy pruning removes minimally changing tokens across frames, whereas for high-dynamic scenes, a saliency-guided spatial pruning strategy retains visually informative intra-frame tokens. To further reduce cross-modal redundancy, a mutual information-based module preserves only the visual tokens most relevant to the textual input, yielding a compact yet semantically meaningful video-language representation. Extensive experiments on multiple video-language benchmarks show that AdaCompVL removes 85% of visual tokens while retaining 99% of the original performance, achieving up to a 1.75× inference speedup. These results demonstrate that AdaCompVL produces compact and semantically relevant video representations for efficient video-language modeling. Our code is publicly available at https: //github.com/JianXin-M/AdaCompVL.

Для цитирования: Ma Jianxin, Jin Shibo, Dang Lujuan, Chen Liangjun, Chen Badong. AdaCompVL: Adaptive Compression of Spatiotemporal and Cross-Modal Redundancy for Efficient Video-Language Learning.. IEEE transactions on image processing : a publication of the IEEE Signal Processing Society. 2026. DOI: 10.1109/tip.2026.3736818.
Подготовка и перевод публикации
Обработка статьи · этапы, ошибки и управление
Загрузка состояния…

История · было → стало

Состояние обновляется каждые 5 секунд, пока блок открыт. Процент показывается только там, где известен объём работы. Пауза останавливает продолжение этапа; текущий запрос к источнику может завершиться.

Тип публикации указан по данным источника. Уровень доказательности автоматически не присваивается.