Differentially private graph neural networks for whole-graph classification.
IEEE Trans. Pattern Anal. Mach. Intell. 45, 7308-7318 (2023)
Graph Neural Networks (GNNs) have established themselves as state-of-the-art for many machine learning applications such as the analysis of social and medical networks. Several among these datasets contain privacy-sensitive data. Machine learning with differential privacy is a promising technique to allow deriving insight from sensitive data while offering formal guarantees of privacy protection. However, the differentially private training of GNNs has so far remained under-explored due to the challenges presented by the intrinsic structural connectivity of graphs. In this work, we introduce a framework for differential private graph-level classification. Our method is applicable to graph deep learning on multi-graph datasets and relies on differentially private stochastic gradient descent (DP-SGD). We show results on a variety of datasets and evaluate the impact of different GNN architectures and training hyperparameters on model performance for differentially private graph classification, as well as the scalability of the method on a large medical dataset. Our experiments show that DP-SGD can be applied to graph classification tasks with reasonable utility losses. Furthermore, we apply explainability techniques to assess whether similar representations are learned in the private and non-private settings. Our results can also function as robust baselines for future work in this area.
Impact Factor
Scopus SNIP
Web of Science
Times Cited
Scopus
Cited By
Altmetric
Publication type
Article: Journal article
Document type
Scientific Article
Thesis type
Editors
Keywords
Training; Privacy; Task analysis; Graph neural networks; Data models; Stochastic processes; Image edge detection; Differential privacy; graph neural networks; Database
Keywords plus
Language
english
Publication Year
2023
Prepublished in Year
0
HGF-reported in Year
2023
ISSN (print) / ISBN
0162-8828
e-ISSN
1939-3539
ISBN
Book Volume Title
Conference Title
Conference Date
Conference Location
Proceedings Title
Quellenangaben
Volume: 45,
Issue: 6,
Pages: 7308-7318
Article Number: ,
Supplement: ,
Series
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Publishing Place
10662 Los Vaqueros Circle, Po Box 3014, Los Alamitos, Ca 90720-1314 Usa
Day of Oral Examination
0000-00-00
Advisor
Referee
Examiner
Topic
University
University place
Faculty
Publication date
0000-00-00
Application date
0000-00-00
Patent owner
Further owners
Application country
Patent priority
Reviewing status
Peer reviewed
Institute(s)
Institute for Machine Learning in Biomed Imaging (IML)
Institute for Tissue Engineering and Regenerative Medicine (ITERM)
POF-Topic(s)
30205 - Bioengineering and Digital Health
Research field(s)
Enabling and Novel Technologies
PSP Element(s)
G-507100-001
G-505800-001
Grants
Copyright
Erfassungsdatum
2024-01-15