PuSH - Publication Server of Helmholtz Zentrum München: Benchmarking large language models for personalized, biomarker-based health intervention recommendations.

Information

Clues to quality of journals

Open Access Policy of Helmholtz Association 2016

CC Licencences

Publication Metrics

Navigation

Home

Deutsch

EVA: Electronic Publishing

New EVA Application

Research

Advanced Search

Browse by ...

... HMGU-Authors/Consortia

... Organizational Structure

... Journal

... Publication Type

... Research Data

... Arbeitsgruppen

... Publication Year

Publication overview

Statistics

Statistics (last 5 years)

OA Publications

Publish

Submit Publication

Import publication from...

...EVA

Report missing publication

Highlights

Support & Contact

Contact persons

Help

Data protection

Helmholtz Open Science

JANE Journal Estimator

SHERPA/RoMEO

DOAJ

Export:

Text

Endnote (RIS) BIB

BibTeX

Jarchow, H.* ; Bobrowski, C.* ; Falk, S.* ; Hermann, A.* ; Kulaga, A.* ; Põder, J.C.* ; Unfried, M.* ; Usanov, N.* ; Zendeh, B.* ; Kennedy, B.K.* ; Lobentanzer, S. ; Fuellen, G.*

Benchmarking large language models for personalized, biomarker-based health intervention recommendations.

NPJ Digit. Med. 8:631 (2025)

Publ. Version/Full Text

Research data

DOI

PMC

	Open Access Gold

Abstract
Metrics
Extra information

The use of large language models (LLMs) in clinical diagnostics and intervention planning is expanding, yet their utility for personalized recommendations for longevity interventions remains opaque. We extended the BioChatter framework to benchmark LLMs' ability to generate personalized longevity intervention recommendations based on biomarker profiles while adhering to key medical validation requirements. Using 25 individual profiles across three different age groups, we generated 1000 diverse test cases covering interventions such as caloric restriction, fasting and supplements. Evaluating 56000 model responses via an LLM-as-a-Judge system with clinician validated ground truths, we found that proprietary models outperformed open-source models especially in comprehensiveness. However, even with Retrieval-Augmented Generation (RAG), all models exhibited limitations in addressing key medical validation requirements, prompt stability, and handling age-related biases. Our findings highlight limited suitability of LLMs for unsupervised longevity intervention recommendations. Our open-source framework offers a foundation for advancing AI benchmarking in various medical contexts.

Impact Factor

Scopus SNIP

Altmetric

15.100

0.000