PuSH - Publication Server of Helmholtz Zentrum München

Becker, S. ; Klein, M.* ; Neitz, A.* ; Parascandolo, G.* ; Kilbertus, N.

Predicting Ordinary Differential Equations with Transformers.

In: (Proceedings of Machine Learning Research). 2023. 1978-2002 (Proceedings of Machine Learning Research ; 202)
We develop a transformer-based sequence-to-sequence model that recovers scalar ordinary differential equations (ODEs) in symbolic form from irregularly sampled and noisy observations of a single solution trajectory. We demonstrate in extensive empirical evaluations that our model performs better or on par with existing methods in terms of accurate recovery across various settings. Moreover, our method is efficiently scalable: after one-time pretraining on a large set of ODEs, we can infer the governing law of a new observed solution in a few forward passes of the model.
Additional Metrics?
[➜Log in]
Edit extra informations Login
Publication type Article: Conference contribution
Corresponding Author
Conference Title Proceedings of Machine Learning Research
Quellenangaben Volume: 202, Issue: , Pages: 1978-2002 Article Number: , Supplement: ,
Non-patent literature Publications
Institute(s) Helmholtz Artifical Intelligence Cooperation Unit (HAICU)
Institute of Computational Biology (ICB)