PuSH - Publication Server of Helmholtz Zentrum München

Dehner, C. ; Zahnd, G. ; Ntziachristos, V. ; Jüstel, D.

A deep neural network for real-time optoacoustic image reconstruction with adjustable speed of sound.

Nat. Mach. Intell. 5, 1130–1141 (2023)
DOI
Open Access Green as soon as Postprint is submitted to ZB.
Multispectral optoacoustic tomography is a high-resolution functional imaging modality that can non-invasively access a broad range of pathophysiological phenomena. Real-time imaging would enable translation of multispectral optoacoustic tomography into clinical imaging, visualize dynamic pathophysiological changes associated with disease progression and enable in situ diagnoses. Model-based reconstruction affords state-of-the-art optoacoustic images but cannot be used for real-time imaging. On the other hand, deep learning enables fast reconstruction of optoacoustic images, but the lack of experimental ground-truth training data leads to reduced image quality for in vivo scans. In this work we achieve accurate optoacoustic image reconstruction in 31 ms per image for arbitrary (experimental) input data by expressing model-based reconstruction with a deep neural network. The proposed deep learning framework, DeepMB, generalizes to experimental test data through training on optoacoustic signals synthesized from real-world images and ground truth optoacoustic images generated by model-based reconstruction. Based on qualitative and quantitative evaluation on a diverse dataset of in vivo images, we show that DeepMB reconstructs images approximately 1,000-times faster than the iterative model-based reference method while affording near-identical image qualities. Accurate and real-time image reconstructions with DeepMB can enable full access to the high-resolution and multispectral contrast of handheld optoacoustic tomography, thus adoption into clinical routines.
Altmetric
Additional Metrics?
[➜Log in]
Edit extra informations Login
Publication type Article: Journal article
Document type Scientific Article
Corresponding Author
Keywords Response Characterization Method; Inverse Problems; Tomography; Algorithm
ISSN (print) / ISBN 2522-5839
e-ISSN 2522-5839
Journal Nature machine intelligence
Quellenangaben Volume: 5, Issue: , Pages: 1130–1141 Article Number: , Supplement: ,
Publisher Springer
Publishing Place [London]
Non-patent literature Publications
Reviewing status Peer reviewed
Institute(s) Institute of Biological and Medical Imaging (IBMI)
Institute of Computational Biology (ICB)
Grants European Research Council (ERC) under the European Union
Bavarian Ministry of Economic Affairs, Energy and Technology (StMWi)