PuSH - Publikationsserver des Helmholtz Zentrums München

Shetab Boushehri, S. ; Qasim, A.B. ; Waibel, D.J.E. ; Schmich, F.* ; Marr, C.

Systematic comparison of incomplete-supervision approaches for biomedical image classification.

Lect. Notes Comput. Sc. 13529 LNCS, 355-365 (2022)
Postprint DOI
Open Access Green
Creative Commons Lizenzvertrag
Deep learning based classification of biomedical images requires expensive manual annotation by experts. Incomplete-supervision approaches including active learning, pre-training, and semi-supervised learning have thus been developed to increase classification performance with a limited number of annotated images. In practice, a combination of these approaches is often used to reach the desired performance for biomedical images. Most of these approaches are designed for natural images, which differ fundamentally from biomedical images in terms of color, contrast, image complexity, and class imbalance. In addition, it is not always clear which combination to use in practical cases. We, therefore, analyzed the performance of combining seven active learning, three pre-training, and two semi-supervised methods on four exemplary biomedical image datasets covering various imaging modalities and resolutions. The results showed that the ImageNet (pre-training) in combination with pseudo-labeling (semi-supervised learning) dominates the best performing combinations, while no particular active learning algorithm prevailed. For three out of four datasets, this combination reached over 90% of the fully supervised results by only adding 25% of labeled data. An ablation study also showed that pre-training and semi-supervised learning contributed up to 25% increase in F1-score in each cycle. In contrast, active learning contributed less than 5% increase in each cycle. Based on these results, we suggest employing the correct combination of pre-training and semi-supervised learning can be more efficient than active learning for biomedical image classification with limited annotated images. We believe that our study is an important step towards annotation-efficient model training for biomedical classification challenges.
Altmetric
Weitere Metriken?
[➜Einloggen]
Zusatzinfos bearbeiten [➜Einloggen]
Publikationstyp Artikel: Journalartikel
Dokumenttyp Wissenschaftlicher Artikel
Korrespondenzautor
Schlagwörter Active Learning ; Biomedical Imaging ; Deep Learning ; Incomplete-supervision ; Pre-training ; Self-supervised Learning ; Semi-supervised ; Transfer Learning
ISSN (print) / ISBN 0302-9743
e-ISSN 1611-3349
Konferenztitel International Conference on Artificial Neural Networks
Zeitschrift Lecture Notes in Computer Science
Quellenangaben Band: 13529 LNCS, Heft: , Seiten: 355-365 Artikelnummer: , Supplement: ,
Verlag Springer
Verlagsort Berlin [u.a.]
Nichtpatentliteratur Publikationen
Institut(e) Institute of AI for Health (AIH)
Institute of Computational Biology (ICB)
Förderungen Helmholtz Association
European Research Council
Horizon 2020 Framework Programme
F. Hoffmann-La Roche