MedElevator Войти в исследования
← Поиск публикаций

DOI 10.1038/s41591-026-04521-4

Медицинская библиотека · Nature medicine · 2026

End-to-end multimodal pathology foundation model with clinical dialogue.

Vorontsov Eugene, Shaikovski George, Casson Adam, Viret Julian, Zimmermann Eric, Tenenholtz Neil, Wang Yi Kan, Bernhard Jan H, Godrich Ran A, Retamero Juan A, Shia Jinru, Gonen Mithat, Weiser Martin R, Klimstra David S, Yousfi Razik, Fusi Nicolò, Fuchs Thomas J, Severson Kristen, Liu Siqi

СтатьяПеревод в очереди

Аннотация

Recent rapid progress in the field of computational pathology has been enabled by foundation models. These models are beginning to move beyond encoding image patches toward whole-slide understanding, but their clinical utility remains limited. Here we present PRISM2, a multimodal slide-level foundation model trained on 2.3 million whole-slide images and 14 million question-answer pairs derived from 700,000 pathology reports. Through clinical dialogue supervision, PRISM2 aligns histomorphology with diagnostic reasoning, yielding representations that support both prompt-based inference and transferable embeddings for downstream tasks. With prompt-based inference, PRISM2 achieves or exceeds (P < 0.05) the balanced accuracy of clinical-grade products calibrated for cancer detection in the prostate, breast and breast lymph node. Additionally, across comprehensive diagnostic, biomarker and survival benchmarks, PRISM2 embeddings never statistically underperform previous foundation models via linear probing (P < 0.05). Furthermore, task-specific fine-tuning on survival prediction outperforms training from scratch on the same large survival dataset. PRISM2 demonstrates how language-supervised pretraining provides a scalable, clinically grounded signal for generalizable pathology representations, bridging human diagnostic reasoning and foundation model performance.

Для цитирования: Vorontsov Eugene, Shaikovski George, Casson Adam, Viret Julian, Zimmermann Eric, Tenenholtz Neil, Wang Yi Kan, Bernhard Jan H, Godrich Ran A, Retamero Juan A, Shia Jinru, Gonen Mithat, Weiser Martin R, Klimstra David S, Yousfi Razik, Fusi Nicolò, Fuchs Thomas J, Severson Kristen, Liu Siqi. End-to-end multimodal pathology foundation model with clinical dialogue.. Nature medicine. 2026. DOI: 10.1038/s41591-026-04521-4.

Предметные рубрики MeSH

Подготовка и перевод публикации
Обработка статьи · этапы, ошибки и управление
Загрузка состояния…

История · было → стало

Состояние обновляется каждые 5 секунд, пока блок открыт. Процент показывается только там, где известен объём работы. Пауза останавливает продолжение этапа; текущий запрос к источнику может завершиться.

Тип публикации указан по данным источника. Уровень доказательности автоматически не присваивается.