PuSH - Publication Server of Helmholtz Zentrum München

DiENTeS: Dynamic ENTity segmentation with local-global transformers.

In: (Supervised and Semi-supervised Multi-structure Segmentation and Landmark Detection in Dental Data). Berlin [u.a.]: Springer, 2025. 21-29 (Lect. Notes Comput. Sc. ; 15571 LNCS)
DOI
Semantic segmentation is crucial for accurately identifying anatomical structures and pathological anomalies in medical images, playing a vital role in diagnostics, treatment planning, and disease progression monitoring. Despite significant advancements, the development of flexible and generalizable algorithms that can adapt to the diverse shapes, sizes, and textures of various anatomical regions remains challenging. In this work, we introduce the Dynamic ENTity Segmentation (DiENTeS) model, which leverages Local-global Transformers for 3D medical segmentation. Our model utilizes a transformer-based backbone to extract localized features and propagate them to form a comprehensive global representation. Additionally, we incorporate language features to guide the segmentation process, enabling the generation of specialized convolutional kernels for each category. This approach allows DiENTeS to tackle semantic segmentation as a class-agnostic entity segmentation problem. We validate our method using the ToothFairy2 Challenge, demonstrating its effectiveness in segmenting multiple structures in the maxillofacial region. We will make our code and models publicly available.
Altmetric
Tags
Annotations
Special Publikation
Hide on homepage

Edit extra information
Edit own tags
Private
Edit own annotation
Private
Hide on publication lists
on hompage
Mark as special
publikation
Publication type Article: Conference contribution
Keywords Multimodal Segmentation ; Semantic Segmentation ; Toothfairy2 Challenge ; Vision Transformers
Language english
Publication Year 2025
HGF-reported in Year 2025
ISSN (print) / ISBN 0302-9743
e-ISSN 1611-3349
Conference Title Supervised and Semi-supervised Multi-structure Segmentation and Landmark Detection in Dental Data
Quellenangaben Volume: 15571 LNCS, Issue: , Pages: 21-29 Article Number: , Supplement: ,
Publisher Springer
Publishing Place Berlin [u.a.]
Institute(s) Institute for Machine Learning in Biomed Imaging (IML)
POF-Topic(s) 30205 - Bioengineering and Digital Health
Research field(s) Enabling and Novel Technologies
PSP Element(s) G-507100-001
Scopus ID 105006929893
Erfassungsdatum 2025-06-06