PuSH - Publication Server of Helmholtz Zentrum München

Nadimpalli, K.V.* ; Chattopadhyay, A.* ; Rieck, B.

Euler Characteristic Transform Based Topological Loss for Reconstructing 3D Images from Single 2D Slices.

In: (IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops). 2023. 571-579 (IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops ; 2023-June)
DOI
The computer vision task of reconstructing 3D images, i.e., shapes, from their single 2D image slices is extremely challenging, more so in the regime of limited data. Deep learning models typically optimize geometric loss functions, which may lead to poor reconstructions as they ignore the structural properties of the shape. To tackle this, we propose a novel topological loss function based on the Euler Characteristic Transform. This loss can be used as an inductive bias to aid the optimization of any neural network toward better reconstructions in the regime of limited data. We show the effectiveness of the proposed loss function by incorporating it into SHAPR, a state-of-the-art shape reconstruction model, and test it on two benchmark datasets, viz., Red Blood Cells and Nuclei datasets. We also show a favourable property, namely injectivity and discuss the stability of the topological loss function based on the Euler Characteristic Transform.
Altmetric
Additional Metrics?
[➜Log in]
Edit extra informations Login
Publication type Article: Conference contribution
Corresponding Author
ISSN (print) / ISBN 2160-7508
e-ISSN 2160-7516
Conference Title IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
Quellenangaben Volume: 2023-June, Issue: , Pages: 571-579 Article Number: , Supplement: ,
Non-patent literature Publications
Institute(s) Institute of AI for Health (AIH)