PuSH - Publikationsserver des Helmholtz Zentrums München

Daum, D. ; Osuala, R. ; Riess, A. ; Kaissis, G. ; Schnabel, J.A. ; di Folco, M.

On differentially private 3D medical image synthesis with controllable latent diffusion models.

In: (Deep Generative Models). Berlin [u.a.]: Springer, 2025. 139-149 (Lect. Notes Comput. Sc. ; 15224 LNCS)
DOI
Generally, the small size of public medical imaging datasets coupled with stringent privacy concerns, hampers the advancement of data-hungry deep learning models in medical imaging. This study addresses these challenges for 3D cardiac MRI images in the short-axis view. We propose Latent Diffusion Models that generate synthetic images conditioned on medical attributes, while ensuring patient privacy through differentially private model training. To our knowledge, this is the first work to apply and quantify differential privacy in 3D medical image generation. We pre-train our models on public data and finetune them with differential privacy on the UK Biobank dataset. Our experiments reveal that pre-training significantly improves model performance, achieving a Fréchet Inception Distance (FID) of 26.77 at ϵ=10, compared to 92.52 for models without pre-training. Additionally, we explore the trade-off between privacy constraints and image quality, investigating how tighter privacy budgets affect output controllability and may lead to degraded performance. Our results demonstrate that proper consideration during training with differential privacy can substantially improve the quality of synthetic cardiac MRI images, but there are still notable challenges in achieving consistent medical realism. Code: https://github.com/compai-lab/2024-miccai-dgm-daum.
Altmetric
Weitere Metriken?
[➜Einloggen]
Zusatzinfos bearbeiten [➜Einloggen]
Publikationstyp Artikel: Konferenzbeitrag
Korrespondenzautor
Schlagwörter Cardiac Mri ; Differential Privacy ; Generative Models ; Synthetic Data
ISSN (print) / ISBN 0302-9743
e-ISSN 1611-3349
Konferenztitel Deep Generative Models
Zeitschrift Lecture Notes in Computer Science
Quellenangaben Band: 15224 LNCS, Heft: , Seiten: 139-149 Artikelnummer: , Supplement: ,
Verlag Springer
Verlagsort Berlin [u.a.]
Nichtpatentliteratur Publikationen
Institut(e) Institute for Machine Learning in Biomed Imaging (IML)