PuSH - Publication Server of Helmholtz Zentrum München

Capturing shape information with multi-scale topological loss terms for 3D reconstruction.

Lect. Notes Comput. Sc. 13434 LNCS, 150-159 (2022)
Postprint DOI
Open Access Green
Reconstructing 3D objects from 2D images is both challenging for our brains and machine learning algorithms. To support this spatial reasoning task, contextual information about the overall shape of an object is critical. However, such information is not captured by established loss terms (e.g. Dice loss). We propose to complement geometrical shape information by including multi-scale topological features, such as connected components, cycles, and voids, in the reconstruction loss. Our method uses cubical complexes to calculate topological features of 3D volume data and employs an optimal transport distance to guide the reconstruction process. This topology-aware loss is fully differentiable, computationally efficient, and can be added to any neural network. We demonstrate the utility of our loss by incorporating it into SHAPR, a model for predicting the 3D cell shape of individual cells based on 2D microscopy images. Using a hybrid loss that leverages both geometrical and topological information of single objects to assess their shape, we find that topological information substantially improves the quality of reconstructions, thus highlighting its ability to extract more relevant features from image datasets.
Impact Factor
Scopus SNIP
Scopus
Cited By
Altmetric
0.000
0.534
1
Tags
Annotations
Special Publikation
Hide on homepage

Edit extra information
Edit own tags
Private
Edit own annotation
Private
Hide on publication lists
on hompage
Mark as special
publikation
Publication type Article: Journal article
Document type Scientific Article
Keywords 3d Shape Prediction ; Cubical Complex ; Topological Loss
Language english
Publication Year 2022
HGF-reported in Year 2022
ISSN (print) / ISBN 0302-9743
e-ISSN 1611-3349
Quellenangaben Volume: 13434 LNCS, Issue: , Pages: 150-159 Article Number: , Supplement: ,
Publisher Springer
Publishing Place Berlin [u.a.]
Institute(s) Human-Centered AI (HCA)
Helmholtz Pioneer Campus (HPC)
POF-Topic(s) 30205 - Bioengineering and Digital Health
30201 - Metabolic Health
Research field(s) Enabling and Novel Technologies
Pioneer Campus
PSP Element(s) G-540003-001
G-540007-001
G-510002-001
Scopus ID 85139052308
Erfassungsdatum 2022-11-08