PuSH - Publikationsserver des Helmholtz Zentrums München

Usynin, D.* ; Rueckert, D.* ; Kaissis, G.

Incentivising the federation: Gradient-based metrics for data selection and valuation in private decentralised training.

In: (EICC '24: Proceedings of the 2024 European Interdisciplinary Cybersecurity Conference). ACM, 2024. 179-185 (ACM International Conference Proceeding Series)
DOI
Obtaining high-quality data for collaborative training of machine learning models can be a challenging task due to A) regulatory concerns and B) a lack of data owner incentives to participate. The first issue can be addressed through the combination of distributed machine learning techniques (e.g. federated learning) and privacy enhancing technologies (PET), such as the differentially private (DP) model training. The second challenge can be addressed by rewarding the participants for giving access to data which is beneficial to the training model, which is of particular importance in federated settings, where the data is unevenly distributed. However, DP noise can adversely affect the underrepresented and the atypical (yet often informative) data samples, making it difficult to assess their usefulness. In this work, we investigate how to leverage gradient information to permit the participants of private training settings to select the data most beneficial for the jointly trained model. We assess two such methods, namely variance of gradients (VoG) and the privacy loss-input susceptibility score (PLIS). We show that these techniques can provide the federated clients with tools for principled data selection even in stricter privacy settings.
Altmetric
Tags
Anmerkungen
Besondere Publikation
Auf Hompepage verbergern

Zusatzinfos bearbeiten
Eigene Tags bearbeiten
Privat
Eigene Anmerkung bearbeiten
Privat
Auf Publikationslisten für
Homepage nicht anzeigen
Als besondere Publikation
markieren
Publikationstyp Artikel: Konferenzbeitrag
Schlagwörter Data Valuation ; Differential Privacy ; Federated Learning
Sprache englisch
Veröffentlichungsjahr 2024
HGF-Berichtsjahr 2024
Konferenztitel EICC '24: Proceedings of the 2024 European Interdisciplinary Cybersecurity Conference
Quellenangaben Band: , Heft: , Seiten: 179-185 Artikelnummer: , Supplement: ,
Verlag ACM
Institut(e) Institute for Machine Learning in Biomed Imaging (IML)
POF Topic(s) 30205 - Bioengineering and Digital Health
Forschungsfeld(er) Enabling and Novel Technologies
PSP-Element(e) G-507100-001
Scopus ID 85196160222
Erfassungsdatum 2024-06-25