PuSH - Publication Server of Helmholtz Zentrum München

Niehues, J.M.* ; Müller-Franzes, G.* ; Schirris, Y.* ; Wagner, S. ; Jendrusch, M.* ; Kloor, M.* ; Pearson, A.T.* ; Muti, H.S.* ; Hewitt, K.J.* ; Veldhuizen, G.P.* ; Zigutyte, L.* ; Truhn, D.* ; Kather, J.N.*

Using histopathology latent diffusion models as privacy-preserving dataset augmenters improves downstream classification performance.

Comput. Biol. Med. 175:108410 (2024)
Publ. Version/Full Text DOI PMC
Open Access Hybrid
Creative Commons Lizenzvertrag
Latent diffusion models (LDMs) have emerged as a state-of-the-art image generation method, outperforming previous Generative Adversarial Networks (GANs) in terms of training stability and image quality. In computational pathology, generative models are valuable for data sharing and data augmentation. However, the impact of LDM-generated images on histopathology tasks compared to traditional GANs has not been systematically studied. We trained three LDMs and a styleGAN2 model on histology tiles from nine colorectal cancer (CRC) tissue classes. The LDMs include 1) a fine-tuned version of stable diffusion v1.4, 2) a Kullback-Leibler (KL)-autoencoder (KLF8-DM), and 3) a vector quantized (VQ)-autoencoder deploying LDM (VQF8-DM). We assessed image quality through expert ratings, dimensional reduction methods, distribution similarity measures, and their impact on training a multiclass tissue classifier. Additionally, we investigated image memorization in the KLF8-DM and styleGAN2 models. All models provided a high image quality, with the KLF8-DM achieving the best Frechet Inception Distance (FID) and expert rating scores for complex tissue classes. For simpler classes, the VQF8-DM and styleGAN2 models performed better. Image memorization was negligible for both styleGAN2 and KLF8-DM models. Classifiers trained on a mix of KLF8-DM generated and real images achieved a 4% improvement in overall classification accuracy, highlighting the usefulness of these images for dataset augmentation. Our systematic study of generative methods showed that KLF8-DM produces the highest quality images with negligible image memorization. The higher classifier performance in the generatively augmented dataset suggests that this augmentation technique can be employed to enhance histopathology classifiers for various tasks.
Impact Factor
Scopus SNIP
Altmetric
7.000
1.783
Tags
Annotations
Special Publikation
Hide on homepage

Edit extra information
Edit own tags
Private
Edit own annotation
Private
Hide on publication lists
on hompage
Mark as special
publikation
Publication type Article: Journal article
Document type Scientific Article
Keywords Artificial Intelligence ; Colorectal Cancer ; Computational Pathology ; Diffusion Models ; Generative Adversarial Networks ; Generative Models
Language english
Publication Year 2024
HGF-reported in Year 2024
ISSN (print) / ISBN 0010-4825
e-ISSN 1879-0534
Quellenangaben Volume: 175, Issue: , Pages: , Article Number: 108410 Supplement: ,
Publisher Elsevier
Reviewing status Peer reviewed
POF-Topic(s) 30205 - Bioengineering and Digital Health
Research field(s) Enabling and Novel Technologies
PSP Element(s) G-530006-001
Scopus ID 85191150510
PubMed ID 38678938
Erfassungsdatum 2024-05-23