PuSH - Publication Server of Helmholtz Zentrum München

Tomczak, A.* ; Ilic, S.* ; Marquardt, G.* ; Engel, T.* ; Förster, F.* ; Navab, N.* ; Albarqouni, S.

Multi-task multi-domain learning for digital staining and classification of leukocytes.

IEEE Trans. Med. Imaging 40, Special Issue on Annotation-efficient Deep Learning for Medical Imaging, 2897-2910 (2020)
DOI PMC
Open Access Green as soon as Postprint is submitted to ZB.
IEEE This paper addresses digital staining and classification of the unstained white blood cell images obtained with a differential contrast microscope. We have data coming from multiple domains that are partially labeled and partially matching across the domains. Using unstained images removes time-consuming staining procedures and could facilitate and automatize comprehensive diagnostics. To this aim, we propose a method that translates unstained images to realistically looking stained images preserving the inter-cellular structures, crucial for the medical experts to perform classification. We achieve better structure preservation by adding auxiliary tasks of segmentation and direct reconstruction. Segmentation enforces that the network learns to generate correct nucleus and cytoplasm shape, while direct reconstruction enforces reliable translation between the matching images across domains. Besides, we build a robust domain agnostic latent space by injecting the target domain label directly to the generator, i.e., bypassing the encoder. It allows the encoder to extract features independently of the target domain and enables an automated domain invariant classification of the white blood cells. We validated our method on a large dataset composed of leukocytes of 24 patients, achieving state-of-the-art performance on both digital staining and classification tasks.
Altmetric
Additional Metrics?
[➜Log in]
Edit extra informations Login
Publication type Article: Journal article
Document type Scientific Article
Corresponding Author
Keywords Blood Cells ; Feature Extraction ; Generative Adversarial Networks ; Generators ; Hematology ; Image Reconstruction ; Image Segmentation ; Image-to-image Translation ; Microscopy ; Microscopy Imaging ; Task Analysis ; White Blood Cells; Image Synthesis; Cells
ISSN (print) / ISBN 0278-0062
e-ISSN 1558-254X
Journal IEEE Transactions on Medical Imaging
Quellenangaben Volume: 40, Issue: 10, Pages: 2897-2910, Article Number: , Supplement: Special Issue on Annotation-efficient Deep Learning for Medical Imaging
Publisher Institute of Electrical and Electronics Engineers (IEEE)
Publishing Place New York, NY [u.a.]
Non-patent literature Publications
Reviewing status Peer reviewed
Institute(s) Helmholtz AI - HMGU (HAI - HMGU)
Grants German Federal Ministry of Education and Research (BMBF)
PRIME programme of the German Academic Exchange Service (DAAD)