PuSH - Publication Server of Helmholtz Zentrum München

Sens, D. ; Sadafi, A. ; Casale, F.P. ; Navab, N.* ; Marr, C.

BEL: A Bag Embedding Loss for Transformer Enhances Multiple Instance Whole Slide Image Classification.

In: (Proceedings - International Symposium on Biomedical Imaging, 18-21 April 2023, Cartagena, Colombia). 345 E 47th St, New York, Ny 10017 Usa: Ieee, 2023. 5 (Proceedings - International Symposium on Biomedical Imaging ; 2023-April)
DOI
Multiple Instance Learning (MIL) has become the predominant approach for classification tasks on gigapixel histopathology whole slide images (WSIs). Within the MIL framework, single WSIs (bags) are decomposed into patches (instances), with only WSI-level annotation available. Recent MIL approaches produce highly informative bag level representations by utilizing the transformer architecture's ability to model the dependencies between instances. However, when applied to high magnification datasets, problems emerge due to the large number of instances and the weak supervisory learning signal. To address this problem, we propose to additionally train transformers with a novel Bag Embedding Loss (BEL). BEL forces the model to learn a discriminative bag-level representation by minimizing the distance between bag embeddings of the same class and maximizing the distance between different classes. We evaluate BEL with the Transformer architecture TransMIL on two publicly available histopathology datasets, BRACS and CAMELYON17. We show that with BEL, TransMIL outperforms the baseline models on both datasets, thus contributing to the clinically highly relevant AI-based tumor classification of histological patient material.
Altmetric
Additional Metrics?
[➜Log in]
Edit extra informations Login
Publication type Article: Conference contribution
Corresponding Author
Keywords Bag-level Representation Learning ; Computational Pathology ; Multiple Instance Learning ; Transformer ; Whole Slide Imaging
ISSN (print) / ISBN 1945-7928
e-ISSN 1945-8452
Conference Title Proceedings - International Symposium on Biomedical Imaging
Conference Date 18-21 April 2023
Conference Location Cartagena, Colombia
Quellenangaben Volume: 2023-April, Issue: , Pages: 5 Article Number: , Supplement: ,
Publisher Ieee
Publishing Place 345 E 47th St, New York, Ny 10017 Usa
Non-patent literature Publications
Institute(s) Institute of AI for Health (AIH)
Grants European Research Council (ERC) under the European Union