Grexa, I.* ; Iván, Z.Z.* ; Migh, E.* ; Kovács, F.* ; Bolck, H.A.* ; Zheng, X.* ; Mund, A.* ; Moshkov, N.* ; Miczán, V.* ; Koos, K.* ; Horvath, P.
     
    
        
SuperCUT, an unsupervised multimodal image registration with deep learning for biomedical microscopy.
    
    
        
    
    
        
        Brief. Bioinform. 25:bbae029 (2024)
    
    
    
      
      
	
	    Numerous imaging techniques are available for observing and interrogating biological samples, and several of them can be used consecutively to enable correlative analysis of different image modalities with varying resolutions and the inclusion of structural or molecular information. Achieving accurate registration of multimodal images is essential for the correlative analysis process, but it remains a challenging computer vision task with no widely accepted solution. Moreover, supervised registration methods require annotated data produced by experts, which is limited. To address this challenge, we propose a general unsupervised pipeline for multimodal image registration using deep learning. We provide a comprehensive evaluation of the proposed pipeline versus the current state-of-the-art image registration and style transfer methods on four types of biological problems utilizing different microscopy modalities. We found that style transfer of modality domains paired with fully unsupervised training leads to comparable image registration accuracy to supervised methods and, most importantly, does not require human intervention.
	
	
	    
	
       
      
	
	    
		Impact Factor
		Scopus SNIP
		Web of Science
Times Cited
		Scopus
Cited By
		Altmetric
		
	     
	    
	 
       
      
     
    
        Publication type
        Article: Journal article
    
 
    
        Document type
        Scientific Article
    
 
    
        Thesis type
        
    
 
    
        Editors
        
    
    
        Keywords
        Correlative Microscopy ; Deep Learning ; Microscopy ; Unsupervised Multimodal Image Registration; Pathology
    
 
    
        Keywords plus
        
    
 
    
    
        Language
        english
    
 
    
        Publication Year
        2024
    
 
    
        Prepublished in Year
        0
    
 
    
        HGF-reported in Year
        2024
    
 
    
    
        ISSN (print) / ISBN
        1467-5463
    
 
    
        e-ISSN
        1477-4054
    
 
    
        ISBN
        
    
    
        Book Volume Title
        
    
 
    
        Conference Title
        
    
 
	
        Conference Date
        
    
     
	
        Conference Location
        
    
 
	
        Proceedings Title
        
    
 
     
	
    
        Quellenangaben
        
	    Volume: 25,  
	    Issue: 2,  
	    Pages: ,  
	    Article Number: bbae029 
	    Supplement: ,  
	
    
 
    
        
            Series
            
        
 
        
            Publisher
            Oxford University Press
        
 
        
            Publishing Place
            Great Clarendon St, Oxford Ox2 6dp, England
        
 
	
        
            Day of Oral Examination
            0000-00-00
        
 
        
            Advisor
            
        
 
        
            Referee
            
        
 
        
            Examiner
            
        
 
        
            Topic
            
        
 
	
        
            University
            
        
 
        
            University place
            
        
 
        
            Faculty
            
        
 
    
        
            Publication date
            0000-00-00
        
 
         
        
            Application date
            0000-00-00
        
 
        
            Patent owner
            
        
 
        
            Further owners
            
        
 
        
            Application country
            
        
 
        
            Patent priority
            
        
 
    
        Reviewing status
        Peer reviewed
    
 
    
        Institute(s)
        Institute of AI for Health (AIH)
    
 
    
        POF-Topic(s)
        30205 - Bioengineering and Digital Health
    
 
    
        Research field(s)
        Enabling and Novel Technologies
    
 
    
        PSP Element(s)
        G-540009-001
    
 
    
        Grants
        New National Excellence Program of the Ministry for Culture and Innovation
National Research, Development, and Innovation Fund
    
 
    
        Copyright
        
    
 	
    
    
    
    
    
        Erfassungsdatum
        2024-07-29