PuSH - Publication Server of Helmholtz Zentrum München

Fogelberg, K.* ; Chamarthi, S.* ; Maron, R.C.* ; Niebling, J.* ; Brinker, T.J.*

Domain shifts in dermoscopic skin cancer datasets: Evaluation of essential limitations for clinical translation.

New Biotech. 76, 106-117 (2023)
Postprint DOI
Open Access Gold
The limited ability of Convolutional Neural Networks to generalize to images from previously unseen domains is a major limitation, in particular, for safety-critical clinical tasks such as dermoscopic skin cancer classification. In order to translate CNN-based applications into the clinic, it is essential that they are able to adapt to domain shifts. Such new conditions can arise through the use of different image acquisition systems or varying lighting conditions. In dermoscopy, shifts can also occur as a change in patient age or occurrence of rare lesion localizations (e.g. palms). These are not prominently represented in most training datasets and can therefore lead to a decrease in performance. In order to verify the generalizability of classification models in real world clinical settings it is crucial to have access to data which mimics such domain shifts. To our knowledge no dermoscopic image dataset exists where such domain shifts are properly described and quantified. We therefore grouped publicly available images from ISIC archive based on their metadata (e.g. acquisition location, lesion localization, patient age) to generate meaningful domains. To verify that these domains are in fact distinct, we used multiple quantification measures to estimate the presence and intensity of domain shifts. Additionally, we analyzed the performance on these domains with and without an unsupervised domain adaptation technique. We observed that in most of our grouped domains, domain shifts in fact exist. Based on our results, we believe these datasets to be helpful for testing the generalization capabilities of dermoscopic skin cancer classifiers.
Impact Factor
Scopus SNIP
Web of Science
Times Cited
Altmetric
5.400
1.327
1
Tags
Annotations
Special Publikation
Hide on homepage

Edit extra information
Edit own tags
Private
Edit own annotation
Private
Hide on publication lists
on hompage
Mark as special
publikation
Publication type Article: Journal article
Document type Scientific Article
Keywords Clinical Translation ; Dermoscopic Image ; Domain Shift ; Generalization ; Skin Lesion Classification ; Unsupervised Domain Adaptation; Convolutional Neural-network; Jensen-shannon Divergence; Classification; Adaptation; Dermatologists
Language english
Publication Year 2023
HGF-reported in Year 2023
ISSN (print) / ISBN 1871-6784
e-ISSN 1876-4347
Quellenangaben Volume: 76, Issue: , Pages: 106-117 Article Number: , Supplement: ,
Publisher Elsevier
Publishing Place Radarweg 29, 1043 Nx Amsterdam, Netherlands
Reviewing status Peer reviewed
Institute(s) Helmholtz AI - DLR (HAI - DLR)
Grants Helmholtz AI funding
Helmholtz Artificial Intelligence Cooperation Unit (HAICU), Germany
Scopus ID 85160526683
Erfassungsdatum 2023-10-06