Bihler, M.* ; Roming, L.* ; Jiang, Y.* ; Afifi, A.J.* ; Aderhold, J.* ; Čibiraitė-Lukenskienė, D.* ; Lorenz, S.* ; Gloaguen, R.* ; Gruna, R.* ; Heizmann, M.*
    
 
    
        
Multi-sensor Data Fusion Using Deep Learning for Bulky Waste Image Classification.
    
    
        
    
    
        
        Proc. SPIE 12623 (2023)
    
    
		
		
		  DOI
 DOI
		
		
		
		
		  
		
		
			 möglich sobald  bei der ZB eingereicht worden ist.
		
     
    
		
		
			
				Deep learning techniques are commonly utilized to tackle various computer vision problems, including recognition, segmentation, and classification from RGB images. With the availability of a diverse range of sensors, industry-specific datasets are acquired to address specific challenges. These collected datasets have varied modalities, indicating that the images possess distinct channel numbers and pixel values that have different interpretations. Implementing deep learning methods to attain optimal outcomes on such multimodal data is a complicated procedure. To enhance the performance of classification tasks in this scenario, one feasible approach is to employ a data fusion technique. Data fusion aims to use all the available information from all sensors and integrate them to obtain an optimal outcome. This paper investigates early fusion, intermediate fusion, and late fusion in deep learning models for bulky waste image classification. For training and evaluation of the models, a multimodal dataset is used. The dataset consists of RGB, hyperspectral near-infrared (NIR), Thermography, and Terahertz images of bulky waste. The results of this work show that multimodal sensor fusion can enhance classification accuracy compared to a single-sensor approach for the used dataset. Hereby, late fusion performed the best with an accuracy of 0.921 compared to intermediate and early fusion, on our test data.
			
			
				
			
		 
		
			
				
					
					Impact Factor
					Scopus SNIP
					Web of Science
Times Cited
					Scopus
Cited By
					
					Altmetric
					
				 
				
			 
		 
		
     
    
        Publikationstyp
        Artikel: Journalartikel
    
 
    
        Dokumenttyp
        Wissenschaftlicher Artikel
    
 
    
        Typ der Hochschulschrift
        
    
 
    
        Herausgeber
        
    
    
        Schlagwörter
        Cnn ; Data Fusion ; Early Fusion ; Image Classification ; Intermediate Fusion ; Late Fusion ; Multi-sensor Data ; Multi-stream Model ; Multimodal Data ; Multispectral Data
    
 
    
        Keywords plus
        
    
 
    
    
        Sprache
        englisch
    
 
    
        Veröffentlichungsjahr
        2023
    
 
    
        Prepublished im Jahr 
        0
    
 
    
        HGF-Berichtsjahr
        2023
    
 
    
    
        ISSN (print) / ISBN
        0277-786X
    
 
    
        e-ISSN
        1996-756X
    
 
    
        ISBN
        
    
 
    
        Bandtitel
        
    
 
    
        Konferenztitel
        
    
 
	
        Konferzenzdatum
        
    
     
	
        Konferenzort
        
    
 
	
        Konferenzband
        
    
 
     
		
    
        Quellenangaben
        
	    Band: 12623 
	    Heft: ,  
	    Seiten: ,  
	    Artikelnummer: ,  
	    Supplement: ,  
	
    
 
  
        
            Reihe
            
        
 
        
            Verlag
            SPIE
        
 
        
            Verlagsort
            
        
 
	
        
            Tag d. mündl. Prüfung
            0000-00-00
        
 
        
            Betreuer
            
        
 
        
            Gutachter
            
        
 
        
            Prüfer
            
        
 
        
            Topic
            
        
 
	
        
            Hochschule
            
        
 
        
            Hochschulort
            
        
 
        
            Fakultät
            
        
 
    
        
            Veröffentlichungsdatum
            0000-00-00
        
 
         
        
            Anmeldedatum
            0000-00-00
        
 
        
            Anmelder/Inhaber
            
        
 
        
            weitere Inhaber
            
        
 
        
            Anmeldeland
            
        
 
        
            Priorität
            
        
 
    
        Begutachtungsstatus
        Peer reviewed
    
 
    
        Institut(e)
        Helmholtz AI - KIT (HAI - KIT)
    
 
    
        POF Topic(s)
        
    
 
    
        Forschungsfeld(er)
        
    
 
    
        PSP-Element(e)
        
    
 
    
        Förderungen
        
    
 
    
        Copyright
        
    
 	
    
    
    
        Erfassungsdatum
        2023-10-18