PuSH - Publikationsserver des Helmholtz Zentrums München

Roughley, S.J.* ; Müller, J.P.* ; Gao, S.* ; Gao, Z.* ; Ligero, M.* ; Blums, R.* ; Crispin-Ortuzar, M.* ; Schnabel, J.A. ; Kainz, B.* ; Bercea, C.-I. ; Machado, I.P.*

GroundingDINO for Open-Set Lesion Detection in Medical Imaging.

In: (Empowering Medical Image Computing and Research Through Early-Career Expertise). Berlin [u.a.]: Springer, 2026. 37-46 (Lect. Notes Comput. Sc. ; 16534 LNCS)
DOI
Open-world anomaly detection is a task in which machine learning is well-positioned to advance cancer diagnosis, potentially leading to significantly improved survival rates. For a model to be used in clinical settings, it must demonstrate high performance, robustness, and generalisability. A common approach to achieving high generalisability is to incorporate information from broader representations within the model. In this work, we investigate the application of GroundingDINO to medical anomaly detection and localisation, evaluating both its overall performance and the influence of text prompts. We find that GroundingDINO outperforms the YOLOv11n model even with minimal use of contextual information. When exploring methods to introduce more contextual information, we observe that specifying the organ within the prompt improves closed-set performance on rarer lesion classes. However, adding visual descriptions of lesions during training leads to a significant performance drop on those subsets, indicating that the model memorises prompt-image pairs rather than learning meaningful semantic relationships. Our work highlights a critical limitation of GroundingDINO in medical imaging and proposes targeted modifications to the model architecture or training strategies as promising directions for utilising richer semantic prompts to improve anomaly detection.
Altmetric
Weitere Metriken?
[➜Einloggen]
Zusatzinfos bearbeiten [➜Einloggen]
Publikationstyp Artikel: Konferenzbeitrag
Schlagwörter Anomaly Detection ; Cancer Research ; Groundingdino ; Lesion Detection ; Medical Imaging ; Prompt Engineering
ISSN (print) / ISBN 0302-9743
e-ISSN 1611-3349
Konferenztitel Empowering Medical Image Computing and Research Through Early-Career Expertise
Zeitschrift Lecture Notes in Computer Science
Quellenangaben Band: 16534 LNCS, Heft: , Seiten: 37-46 Artikelnummer: , Supplement: ,
Verlag Springer
Verlagsort Berlin [u.a.]
Institut(e) Institute of Machine Learning in Biomedical Imaging (IML)