PuSH - Publication Server of Helmholtz Zentrum München

Rasheed, H. ; Dorent, R.* ; Fehrentz, M.* ; Kapur, T.* ; Wells, W.M.* ; Golby, A.* ; Frisken, S.* ; Schnabel, J.A. ; Haouchine, N.*

Learning to match 2D keypoints across preoperative MR and intraoperative ultrasound.

In: (Simplifying Medical Ultrasound). Berlin [u.a.]: Springer, 2025. 78-87 (Lect. Notes Comput. Sc. ; 15186 LNCS)
DOI
We propose in this paper a texture-invariant 2D keypoints descriptor specifically designed for matching preoperative Magnetic Resonance (MR) images with intraoperative Ultrasound (US) images. We introduce a matching-by-synthesis strategy, where intraoperative US images are synthesized from MR images accounting for multiple MR modalities and intraoperative US variability. We build our training set by enforcing keypoints localization over all images then train a patient-specific descriptor network that learns texture-invariant discriminant features in a supervised contrastive manner, leading to robust keypoints descriptors. Our experiments on real cases with ground truth show the effectiveness of the proposed approach, outperforming the state-of-the-art methods and achieving 80.35% matching precision on average.
Altmetric
Additional Metrics?
Edit extra informations Login
Publication type Article: Conference contribution
Corresponding Author
ISSN (print) / ISBN 0302-9743
e-ISSN 1611-3349
Conference Title Simplifying Medical Ultrasound
Quellenangaben Volume: 15186 LNCS, Issue: , Pages: 78-87 Article Number: , Supplement: ,
Publisher Springer
Publishing Place Berlin [u.a.]
Non-patent literature Publications
Institute(s) Institute for Machine Learning in Biomed Imaging (IML)