PuSH - Publikationsserver des Helmholtz Zentrums München

Tanida, T.* ; Müller, P.* ; Kaissis, G. ; Rueckert, D.*

Interactive and xxplainable region-guided radiology report generation.

In: (IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 17-24 June 2023, Vancouver, BC, Canada). 10662 Los Vaqueros Circle, Po Box 3014, Los Alamitos, Ca 90720-1264 Usa: Ieee Computer Soc, 2023. 7433-7442 (Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition ; 2023-June)
DOI
The automatic generation of radiology reports has the potential to assist radiologists in the time-consuming task of report writing. Existing methods generate the full report from image-level features, failing to explicitly focus on anatomical regions in the image. We propose a simple yet effective region-guided report generation model that detects anatomical regions and then describes individual, salient regions to form the final report. While previous methods generate reports without the possibility of human intervention and with limited explainability, our method opens up novel clinical use cases through additional interactive capabilities and introduces a high degree of transparency and explainability. Comprehensive experiments demonstrate our method's effectiveness in report generation, outperforming previous state-of-the-art models, and highlight its interactive capabilities. The code and checkpoints are available at https://github.com/ttanida/rgrg.
Altmetric
Weitere Metriken?
[➜Einloggen]
Zusatzinfos bearbeiten [➜Einloggen]
Publikationstyp Artikel: Konferenzbeitrag
Korrespondenzautor
Schlagwörter Cell Microscopy ; Medical And Biological Vision
ISSN (print) / ISBN 1063-6919
Konferenztitel IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Konferzenzdatum 17-24 June 2023
Konferenzort Vancouver, BC, Canada
Quellenangaben Band: 2023-June, Heft: , Seiten: 7433-7442 Artikelnummer: , Supplement: ,
Verlag Ieee Computer Soc
Verlagsort 10662 Los Vaqueros Circle, Po Box 3014, Los Alamitos, Ca 90720-1264 Usa
Nichtpatentliteratur Publikationen
Institut(e) Helmholtz Artifical Intelligence Cooperation Unit (HAICU)
Institute for Machine Learning in Biomed Imaging (IML)