PuSH - Publication Server of Helmholtz Zentrum München

Peng, T. ; Boxberg, M.* ; Weichert, W.* ; Navab, N.* ; Marr, C.

Multi-task learning of a deep K-nearest neighbour network for histopathological image classification and retrieval.

Lect. Notes Comput. Sc. 11764 LNCS, 676-684 (2019)
Postprint DOI
Open Access Green
Deep neural networks have achieved tremendous success in image recognition, classification and object detection. However, deep learning is often criticised for its lack of transparency and general inability to rationalise its predictions. The issue of poor model interpretability becomes critical in medical applications: a model that is not understood and trusted by physicians is unlikely to be used in daily clinical practice. In this work, we develop a novel multi-task deep learning framework for simultaneous histopathology image classification and retrieval, leveraging on the classic concept of k-nearest neighbours to improve model interpretability. For a test image, we retrieve the most similar images from our training databases. These retrieved nearest neighbours can be used to classify the test image with a confidence score, and provide a human-interpretable explanation of our classification. Our original framework can be built on top of any existing classification network (and therefore benefit from pretrained models), by (i) combining a triplet loss function with a novel triplet sampling strategy to compare distances between samples and (ii) adding a Cauchy hashing loss function to accelerate neighbour searching. We evaluate our method on colorectal cancer histology slides and show that the confidence estimates are strongly correlated with model performance. Nearest neighbours are intuitive and useful for expert evaluation. They give insights into understanding possible model failures, and can support clinical decision making by comparing archived images and patient records with the actual case.
Altmetric
Additional Metrics?
[➜Log in]
Edit extra informations Login
Publication type Article: Journal article
Document type Scientific Article
Corresponding Author
ISSN (print) / ISBN 0302-9743
e-ISSN 1611-3349
Journal Lecture Notes in Computer Science
Quellenangaben Volume: 11764 LNCS, Issue: , Pages: 676-684 Article Number: , Supplement: ,
Publisher Springer
Publishing Place Berlin [u.a.]
Non-patent literature Publications
Institute(s) Institute of Computational Biology (ICB)