PuSH - Publication Server of Helmholtz Zentrum München

Wollschläger, T.* ; Kemper, N.* ; Hetzel, L. ; Sommer, J.* ; Günnemann, S.*

Expressivity and generalization: Fragment-biases for molecular GNNs.

In: (41st International Conference on Machine Learning, 21-27 July 2024, Vienna). 2024. 53113-53139 (Proceedings of Machine Learning Research ; 235)
Although recent advances in higher-order Graph Neural Networks (GNNs) improve the theoretical expressiveness and molecular property predictive performance, they often fall short of the empirical performance of models that explicitly use fragment information as inductive bias. However, for these approaches, there exists no theoretic expressivity study. In this work, we propose the Fragment-WL test, an extension to the well-known Weisfeiler & Leman (WL) test, which enables the theoretic analysis of these fragment-biased GNNs. Building on the insights gained from the Fragment-WL test, we develop a new GNN architecture and a fragmentation with infinite vocabulary that significantly boosts expressiveness. We show the effectiveness of our model on synthetic and real-world data where we outperform all GNNs on Peptides and have 12% lower error than all GNNs on ZINC and 34% lower error than other fragment-biased models. Furthermore, we show that our model exhibits superior generalization capabilities compared to the latest transformer-based architectures, positioning it as a robust solution for a range of molecular modeling tasks.
Tags
Annotations
Special Publikation
Hide on homepage

Edit extra information
Edit own tags
Private
Edit own annotation
Private
Hide on publication lists
on hompage
Mark as special
publikation
Publication type Article: Conference contribution
Language english
Publication Year 2024
HGF-reported in Year 2024
Conference Title 41st International Conference on Machine Learning
Conference Date 21-27 July 2024
Conference Location Vienna
Quellenangaben Volume: 235, Issue: , Pages: 53113-53139 Article Number: , Supplement: ,
POF-Topic(s) 30205 - Bioengineering and Digital Health
Research field(s) Enabling and Novel Technologies
PSP Element(s) G-503800-001
Scopus ID 85203818936
Erfassungsdatum 2024-09-20