PuSH - Publikationsserver des Helmholtz Zentrums München

Export: TXT Text RIS Endnote (RIS) BIB BibTeX
Hager, P.* ; Jungmann, F.* ; Holland, R.* ; Bhagat, K.* ; Hubrecht, I.* ; Knauer, M.* ; Vielhauer, J.* ; Makowski, M.* ; Braren, R.* ; Kaissis, G. ; Rueckert, D.*

Evaluation and mitigation of the limitations of large language models in clinical decision-making.

Nat. Med., DOI: 10.1038/s41591-024-03097-1 (2024)
Verlagsversion DOI PMC
Open Access Hybrid
Creative Commons Lizenzvertrag
Clinical decision-making is one of the most impactful parts of a physician's responsibilities and stands to benefit greatly from artificial intelligence solutions and large language models (LLMs) in particular. However, while LLMs have achieved excellent performance on medical licensing exams, these tests fail to assess many skills necessary for deployment in a realistic clinical decision-making environment, including gathering information, adhering to guidelines, and integrating into clinical workflows. Here we have created a curated dataset based on the Medical Information Mart for Intensive Care database spanning 2,400 real patient cases and four common abdominal pathologies as well as a framework to simulate a realistic clinical setting. We show that current state-of-the-art LLMs do not accurately diagnose patients across all pathologies (performing significantly worse than physicians), follow neither diagnostic nor treatment guidelines, and cannot interpret laboratory results, thus posing a serious risk to the health of patients. Furthermore, we move beyond diagnostic accuracy and demonstrate that they cannot be easily integrated into existing workflows because they often fail to follow instructions and are sensitive to both the quantity and order of information. Overall, our analysis reveals that LLMs are currently not ready for autonomous clinical decision-making while providing a dataset and framework to guide future studies.
Impact Factor
Scopus SNIP
Altmetric
58.700
0.000
Tags
Anmerkungen
Besondere Publikation
Auf Hompepage verbergern

Zusatzinfos bearbeiten
Eigene Tags bearbeiten
Privat
Eigene Anmerkung bearbeiten
Privat
Auf Publikationslisten für
Homepage nicht anzeigen
Als besondere Publikation
markieren
Publikationstyp Artikel: Journalartikel
Dokumenttyp Wissenschaftlicher Artikel
Sprache englisch
Veröffentlichungsjahr 2024
HGF-Berichtsjahr 2024
ISSN (print) / ISBN 1078-8956
e-ISSN 1546-170X
Zeitschrift Nature medicine
Verlag Nature Publishing Group
Verlagsort New York, NY
Begutachtungsstatus Peer reviewed
Institut(e) Institute for Machine Learning in Biomed Imaging (IML)
POF Topic(s) 30205 - Bioengineering and Digital Health
Forschungsfeld(er) Enabling and Novel Technologies
PSP-Element(e) G-507100-001
DOI 10.1038/s41591-024-03097-1
Scopus ID 85197736357
PubMed ID 38965432
Erfassungsdatum 2024-07-16
[➜Korrektur melden]