Genome biology · 2026
Comparative assessment of large language models for microbial phenotype assignment.
СтатьяСравнительное исследованиеНазвание и аннотация: Перевод в очереди
Обработка статьи · этапы, ошибки и управление
Загрузка состояния…
Ошибки и ограничения
История · было → стало
Состояние обновляется каждые 5 секунд, пока блок открыт. Процент показывается только там, где известен объём работы. Пауза останавливает продолжение этапа; текущий запрос к источнику может завершиться.
Münch Philipp C, Safaei Nasim, Mreches René, Binder Martin, Han Yichen, Robertson Gary, Franzosa Eric A, Huttenhower Curtis, McHardy Alice Carolyn
Аннотация
BACKGROUND: Large language models (LLMs) are increasingly used to extract knowledge from text, yet their coverage and reliability in biology remain unclear. Microbial phenotypes are especially important to assess, as comprehensive data remain sparse except for well-studied organisms and they underpin our understanding of microbial characteristics, functional roles, and applications.
RESULTS: Here, we systematically assessed the biological knowledge encoded in publicly available LLMs for structured phenotype assignment of microbial species. We evaluated the performance of up to 57 LLMs across different experiments, including state-of-the-art models such as Claude Sonnet 4 and the GPT-5 family of models. Across phenotypes, LLMs reached accurate assignments for many species, but performance varied widely by model and trait, and no single model dominated. Model self-reported confidence is informative, with higher confidence aligning with higher accuracy, and can be used to prioritize phenotype assignment, effectively distinguishing between high- and low-confidence inferences.
CONCLUSIONS: Overall, our study outlines the utility and limitations of text-based LLMs for phenotype characterization in microbiology.
RESULTS: Here, we systematically assessed the biological knowledge encoded in publicly available LLMs for structured phenotype assignment of microbial species. We evaluated the performance of up to 57 LLMs across different experiments, including state-of-the-art models such as Claude Sonnet 4 and the GPT-5 family of models. Across phenotypes, LLMs reached accurate assignments for many species, but performance varied widely by model and trait, and no single model dominated. Model self-reported confidence is informative, with higher confidence aligning with higher accuracy, and can be used to prioritize phenotype assignment, effectively distinguishing between high- and low-confidence inferences.
CONCLUSIONS: Overall, our study outlines the utility and limitations of text-based LLMs for phenotype characterization in microbiology.