PuSH - Publication Server of Helmholtz Zentrum München

Ahmad Madni, H.* ; Umer, R.M. ; Luca Foresti, G.*

Exploiting data diversity in multi-domain federated learning.

Mach. Learn.: Sci. Technol. 5:025041 (2024)
Publ. Version/Full Text DOI
Open Access Gold
Creative Commons Lizenzvertrag
Federated learning (FL) is an evolving machine learning technique that allows collaborative model training without sharing the original data among participants. In real-world scenarios, data residing at multiple clients are often heterogeneous in terms of different resolutions, magnifications, scanners, or imaging protocols, and thus challenging for global FL model convergence in collaborative training. Most of the existing FL methods consider data heterogeneity within one domain by assuming same data variation in each client site. In this paper, we consider data heterogeneity in FL with different domains of heterogeneous data by raising the problems of domain-shift, class-imbalance, and missing data. We propose a method, multi-domain FL as a solution to heterogeneous training data from multiple domains by training robust vision transformer model. We use two loss functions, one for correctly predicting class labels and other for encouraging similarity and dissimilarity over latent features, to optimize the global FL model. We perform various experiments using different convolution-based networks and non-convolutional Transformer architectures on multi-domain datasets. We evaluate the proposed approach on benchmark datasets and compare with the existing FL methods. Our results show the superiority of the proposed approach which performs better in term of robust FL global model than the exiting methods.
Impact Factor
Scopus SNIP
Altmetric
6.300
0.000
Tags
Annotations
Special Publikation
Hide on homepage

Edit extra information
Edit own tags
Private
Edit own annotation
Private
Hide on publication lists
on hompage
Mark as special
publikation
Publication type Article: Journal article
Document type Scientific Article
Keywords Class-imbalance ; Data Heterogeneity ; Domain-shift ; Federated Learning ; Multi-domain Data
Language english
Publication Year 2024
HGF-reported in Year 2024
ISSN (print) / ISBN 2632-2153
e-ISSN 2632-2153
Quellenangaben Volume: 5, Issue: 2, Pages: , Article Number: 025041 Supplement: ,
Publisher Institute of Physics Publishing (IOP)
Publishing Place Temple Circus, Temple Way, Bristol Bs1 6be, England
Reviewing status Peer reviewed
POF-Topic(s) 30205 - Bioengineering and Digital Health
Research field(s) Enabling and Novel Technologies
PSP Element(s) G-540007-001
Grants
Department Strategic Project of the University of Udine
Scopus ID 85193595534
Erfassungsdatum 2024-07-09