PuSH - Publication Server of Helmholtz Zentrum München

Madni, H.A.* ; Umer, R.M. ; Foresti, G.L.*

Federated learning for data and model heterogeneity in medical imaging.

In: (ICIAP 2023: Image Analysis and Processing - ICIAP 2023 Workshops). Berlin [u.a.]: Springer, 2024. 167-178 (Lect. Notes Comput. Sc. ; 14366)
DOI
Open Access Green as soon as Postprint is submitted to ZB.
Federated Learning (FL) is an evolving machine learning method in which multiple clients participate in collaborative learning without sharing their data with each other and the central server. In real-world applications such as hospitals and industries, FL counters the challenges of data heterogeneity and model heterogeneity as an inevitable part of the collaborative training. More specifically, different organizations, such as hospitals, have their own private data and customized models for local training. To the best of our knowledge, the existing methods do not effectively address both problems of model heterogeneity and data heterogeneity in FL. In this paper, we exploit the data and model heterogeneity simultaneously, and propose a method, MDH-FL (Exploiting Model and Data Heterogeneity in FL) to solve such problems to enhance the efficiency of the global model in FL. We use knowledge distillation and a symmetric loss to minimize the heterogeneity and its impact on the model performance. Knowledge distillation is used to solve the problem of model heterogeneity, and symmetric loss tackles with the data and label heterogeneity. We evaluate our method on the medical datasets to conform the real-world scenario of hospitals, and compare with the existing methods. The experimental results demonstrate the superiority of the proposed approach over the other existing methods.
Altmetric
Additional Metrics?
[➜Log in]
Edit extra informations Login
Publication type Article: Conference contribution
Corresponding Author
Keywords Federated Learning ; Heterogeneous Data ; Heterogeneous Model ; Medical Imaging
ISSN (print) / ISBN 0302-9743
e-ISSN 1611-3349
Conference Title ICIAP 2023: Image Analysis and Processing - ICIAP 2023 Workshops
Journal Lecture Notes in Computer Science
Quellenangaben Volume: 14366, Issue: , Pages: 167-178 Article Number: , Supplement: ,
Publisher Springer
Publishing Place Berlin [u.a.]
Non-patent literature Publications
Institute(s) Institute of AI for Health (AIH)
Grants Departmental Strategic Plan (PSD) of the University of Udine Interdepartmental Project on Artificial Intelligence (2020-2025)