PuSH - Publikationsserver des Helmholtz Zentrums München

Ma, H.* ; Quinzan, F.* ; Willem, T. ; Bauer, S.

AI alignment in medical imaging: Unveiling hidden biases through counterfactual analysis.

PLOS Digit Health 5:e0001516 (2026)
Verlagsversion Forschungsdaten DOI PMC
Open Access Gold
Creative Commons Lizenzvertrag
Machine learning (ML) systems for medical imaging have demonstrated remarkable diagnostic capabilities. However, their susceptibility to learning spurious correlations with sensitive attributes poses significant risks to fairness and safety. In this paper, we introduce a novel statistical framework to evaluate the dependency of medical imaging ML models on sensitive attributes, such as demographics. Our method leverages the concept of counterfactual invariance, measuring the extent to which a model's predictions remain unchanged under hypothetical changes to sensitive attributes. We present a practical algorithm that combines conditional latent diffusion models with statistical hypothesis testing to identify and quantify such biases without requiring direct access to counterfactual data. On synthetic benchmarks, our framework correctly identifies 96.1% of biased models while producing false alarms on 22.0% of fair models. On two real-world chest X-ray datasets, CheXpert and MIMIC-CXR, it detects bias at average rates 96.3%, 95.7% across all diagnostic tasks when models are strongly biased, and its average false alarm rate drops to 15.3%, 14.7%, respectively, for the least biased models, consistently outperforming existing fairness baselines and demonstrating strong alignment with counterfactual fairness principles.
Altmetric
Weitere Metriken?
[➜Einloggen]
Zusatzinfos bearbeiten [➜Einloggen]
Publikationstyp Artikel: Journalartikel
Dokumenttyp Wissenschaftlicher Artikel
Schlagwörter Counterfactual Thinking ; Generalization ; Dependency (uml) ; Medical Imaging ; Statistical Hypothesis Testing ; Statistical Model
ISSN (print) / ISBN 2767-3170
e-ISSN 2767-3170
Zeitschrift PLOS Digital Health
Quellenangaben Band: 5, Heft: 8, Seiten: , Artikelnummer: e0001516 Supplement: ,
Verlag Public Library of Science (PLoS)
Begutachtungsstatus Peer reviewed
Institut(e) Helmholtz Artificial Intelligence Cooperation Unit (HAI)