Open Access Green möglich sobald Postprint bei der ZB eingereicht worden ist.
MAD: Modality Agnostic Distance Measure for Image Registration.
In:. Berlin [u.a.]: Springer, 2023. 147-156 (Lect. Notes Comput. Sc. ; 14394 LNCS)
Multi-modal image registration is a crucial pre-processing step in many medical applications. However, it is a challenging task due to the complex intensity relationships between different imaging modalities, which can result in large discrepancy in image appearance. The success of multi-modal image registration, whether it is conventional or learning based, is predicated upon the choice of an appropriate distance (or similarity) measure. Particularly, deep learning registration algorithms lack in accuracy or even fail completely when attempting to register data from an “unseen” modality. In this work, we present Modality Agnostic Distance (MAD), a deep image distance measure that utilises random convolutions to learn the inherent geometry of the images while being robust to large appearance changes. Random convolutions are geometry-preserving modules which we use to simulate an infinite number of synthetic modalities alleviating the need for aligned paired data during training. We can therefore train MAD on a mono-modal dataset and successfully apply it to a multi-modal dataset. We demonstrate that not only can MAD affinely register multi-modal images successfully, but it has also a larger capture range than traditional measures such as Mutual Information and Normalised Gradient Fields. Our code is available at: https://github.com/ModalityAgnosticDistance/MAD.
Altmetric
Anmerkungen
Besondere Publikation
Auf Hompepage verbergern
Publikationstyp
Artikel: Konferenzbeitrag
Schlagwörter
Distance Measure ; Image Registration ; Mutli-modality; Entropy
Sprache
englisch
Veröffentlichungsjahr
2023
HGF-Berichtsjahr
2023
ISSN (print) / ISBN
0302-9743
e-ISSN
1611-3349
Zeitschrift
Lecture Notes in Computer Science
Quellenangaben
Band: 14394 LNCS,
Seiten: 147-156
Verlag
Springer
Verlagsort
Berlin [u.a.]
Institut(e)
Helmholtz Artifical Intelligence Cooperation Unit (HAICU)
Institute for Machine Learning in Biomed Imaging (IML)
Institute for Machine Learning in Biomed Imaging (IML)
POF Topic(s)
30205 - Bioengineering and Digital Health
Forschungsfeld(er)
Enabling and Novel Technologies
PSP-Element(e)
G-530014-001
G-507100-001
G-507100-001
WOS ID
001211854500014
Scopus ID
85185724686
Erfassungsdatum
2024-03-05