PuSH - Publication Server of Helmholtz Zentrum München

Madni, H.A.* ; Umer, R.M. ; Foresti, G.L.*

Blockchain-based swarm learning for the mitigation of gradient leakage in federated learning.

IEEE Access 11, 16549-16556 (2023)
Publ. Version/Full Text DOI
Open Access Gold
Creative Commons Lizenzvertrag
Federated Learning (FL) is a machine learning technique in which collaborative and distributed learning is performed, while the private data reside locally on the client. Rather than the data, only gradients are shared among all collaborative nodes with the help of a central server. To ensure the data privacy, the gradients are prone to the deformation, or the representation is perturbed before sharing, ultimately reducing the performance of the model. Recent studies show that the original data can still be recovered using latent space (i.e., gradient leakage problem) by Generative Adversarial Network and different optimization algorithms such as Bayesian and Covariance Matrix Adaptation Evolution Strategy. To address the issues of data privacy and gradient leakage, in this paper, we train deep neural networks by exploiting the blockchain-based Swarm Learning (SL) framework. In the SL scheme, instead of sharing perturbed or noisy gradients to the central server, we share the original gradients among authenticated (i.e., blockchain-based smart contract) training nodes. To demonstrate the effectiveness of the SL approach, we evaluate the proposed approach using the standard CIFAR10 and MNIST benchmark datasets and compare it with the other existing methods.
Altmetric
Additional Metrics?
[➜Log in]
Edit extra informations Login
Publication type Article: Journal article
Document type Scientific Article
Corresponding Author
Keywords Blockchain ; Data Privacy ; Federated Learning ; Gradient Leakage ; Model Privacy ; Swarm Learning
ISSN (print) / ISBN 2169-3536
e-ISSN 2169-3536
Journal IEEE Access
Quellenangaben Volume: 11, Issue: , Pages: 16549-16556 Article Number: , Supplement: ,
Publisher IEEE
Publishing Place 445 Hoes Lane, Piscataway, Nj 08855-4141 Usa
Non-patent literature Publications
Reviewing status Peer reviewed
Institute(s) Institute of AI for Health (AIH)
Grants PSD-AI Project at the University of Udine, Italy