DOI 10.1186/s41747-026-00769-0
Technical architecture for integrating vision-language models with DICOM viewers.
Аннотация
Integrating vision-language models (VLMs) into clinical radiology workflows requires exporting two-dimensional images that preserve diagnostic viewing context, including imaging plane, slice position, window/level, slab parameters, and overlays. Existing approaches typically rely on ad hoc screenshots and external uploads, which discard this context, reduce reproducibility, and introduce workflow friction through task switching. We describe a radiology viewer architecture that maintains model interaction entirely within the diagnostic environment by serializing explicit viewer state into replayable descriptors. Requested views are re-rendered offscreen using shared in-memory voxel data, enabling repeatable, context-faithful evidence generation without disrupting interactive interpretation. The user interface employs a split workspace, combining a diagnostic grid for image review with an integrated chat sidebar for evidence staging and model interaction. Capture actions generate batches of serialized viewer states that are executed by an offscreen renderer; the resulting frames are staged for user curation prior to model submission. Under controlled conditions at a 1,000 × 1,000 pixel output resolution, benchmarks demonstrated perfect reproducibility: repeated captures from identical serialized states produced pixel-identical images, with zero hash mismatches across 50 frames. Capture latency ranged from a median of 4.49 to 16.69 ms per frame, depending on view type, and median output size was 27.9 kB per frame using a high-efficiency image container. These results indicate that the proposed architecture supports reproducible, low-latency, and storage-efficient multislice and multiseries evidence assembly at interactive speeds, enabling seamless integration of VLMs into diagnostic radiology workflows. RELEVANCE STATEMENT: Offscreen re-rendering driven by serialized viewing state enables context-preserving and reproducible export of two-dimensional evidence from volumetric radiology viewing, supporting integrated vision-language model workflows with millisecond-scale capture latency from hot cache. KEY POINTS: A split-layout DICOM viewer with an integrated chat interface enables radiologists to capture, stage, and submit visual evidence without leaving the diagnostic environment. Offscreen re-rendering from serialized viewing state produces pixel-identical exports across repeated captures, supporting traceable, auditable, and reproducible evidence generation. Batch capture efficiently assembles multislice, multiplane, and multiseries evidence with minimal manual effort, providing models with richer and more representative study context. Capture latency was millisecond-scale, and high-efficiency image container (HEIC) encoding reduced file size by approximately 2.8-fold compared with the joint photographic experts group (JPEG) format, supporting responsive multi-frame workflows.
Предметные рубрики MeSH
Подготовка и перевод публикации
Обработка статьи · этапы, ошибки и управление
Ошибки и ограничения
История · было → стало
Состояние обновляется каждые 5 секунд, пока блок открыт. Процент показывается только там, где известен объём работы. Пауза останавливает продолжение этапа; текущий запрос к источнику может завершиться.
Тип публикации указан по данным источника. Уровень доказательности автоматически не присваивается.