PuSH - Publication Server of Helmholtz Zentrum München

Koch, V. ; Wagner, S. ; Kazeminia, S. ; Sancar, E. ; Hehr, M. ; Schnabel, J.A. ; Peng, T. ; Marr, C.

DinoBloom: A foundation model for generalizable cell embeddings in hematology.

In: (Computer Vision and Pattern Recognition). Berlin [u.a.]: Springer, 2024. 520-530 (Lect. Notes Comput. Sc. ; 15012 LNCS)
DOI
In hematology, computational models offer significant potential to improve diagnostic accuracy, streamline workflows, and reduce the tedious work of analyzing single cells in peripheral blood or bone marrow smears. However, clinical adoption of computational models has been hampered by the lack of generalization due to large batch effects, small dataset sizes, and poor performance in transfer learning from natural images. To address these challenges, we introduce DinoBloom, the first foundation model for single cell images in hematology, utilizing a tailored DINOv2 pipeline. Our model is built upon an extensive collection of 13 diverse, publicly available datasets of peripheral blood and bone marrow smears, the most substantial open-source cohort in hematology so far, comprising over 380,000 white blood cell images. To assess its generalization capability, we evaluate it on an external dataset with a challenging domain shift. We show that our model outperforms existing medical and non-medical vision models in (i) linear probing and k-nearest neighbor evaluations for cell-type classification on blood and bone marrow smears and (ii) weakly supervised multiple instance learning for acute myeloid leukemia subtyping by a large margin. A family of four DinoBloom models (small, base, large, and giant) can be adapted for a wide range of downstream applications, be a strong baseline for classification problems, and facilitate the assessment of batch effects in new datasets. All models are available at github.com/marrlab/DinoBloom.
Altmetric
Additional Metrics?
[➜Log in]
Edit extra informations Login
Publication type Article: Conference contribution
Corresponding Author
Keywords Foundation Model ; Hematology ; Self-supervised Learning
ISSN (print) / ISBN 0302-9743
e-ISSN 1611-3349
Conference Title Computer Vision and Pattern Recognition
Journal Lecture Notes in Computer Science
Quellenangaben Volume: 15012 LNCS, Issue: , Pages: 520-530 Article Number: , Supplement: ,
Publisher Springer
Publishing Place Berlin [u.a.]
Non-patent literature Publications
Institute(s) Institute of AI for Health (AIH)
Helmholtz Artifical Intelligence Cooperation Unit (HAICU)
Institute for Machine Learning in Biomed Imaging (IML)