Home
Login
Deutsch
Advanced Search
Browse by ...
Publication overview
Contact persons
Help
Publ. Version/Full Text
DOI
 |
Open Access Hybrid |
|
as soon as is submitted to ZB.
MOSAIC: Maximizing out-of-distribution sensitivity via aligned image classification.
Comput. Vis. Image Underst. 271:104885 (2026)
Out-of-Distribution (OOD) classification is a domain generalization task in computer vision. Deep learning models are typically developed and tested under the implicit assumption that training and test data are drawn independently and identically distributed (IID) from the same distribution. Overlooking OOD images can lead to poor performance under unseen or adverse viewing conditions, which are common in real-world scenarios. In this work, the proposed solution can be described as a data-driven approach to solve the OOD classification task in computer vision. The proposed approach consists of three stages, a training stage for exploiting labeled source data with different data augmentation strategies using powerful pretrained vision transformer models, an intermediate stage for weighted model ensemble and post-processing strategies, and finally an inference stage for exploiting unlabeled target data by using test-time learning. The proposed data-driven approach enhances the OOD generalization ability of deep models that withstand shifts in nuisances such as shape, pose, context, texture, occlusion, and weather in OOD or rare scenarios. Extensive data-augmentation strategies are used to improve the OOD generalization of deep models across various nuisances. The effectiveness of the proposed approach is evaluated using two standard computer vision benchmarks: ROBIN and a test set provided by the OOD-CV Challenge 2023. The experimental results show that the proposed approach demonstrates a performance improvement of 2.73% the ROBIN test set and achieves accuracy of 94.04% for the Challenge test set in terms of OOD robustness evaluation with classification accuracy. Furthermore, the proposed solution has secured a position within the top three OOD-based rankings on the OOD-CV Challenge Image Classification Leaderboard, 2023.
Altmetric
Additional Metrics?
Edit extra informations
Login
Publication type
Article: Journal article
Document type
Scientific Article
Keywords
Robustness (evolution) ; Generalization ; Test Set ; Test Data ; Transformer ; Training Set ; Contextual Image Classification ; Inference ; Deep Learning
ISSN (print) / ISBN
1077-3142
e-ISSN
1090-235X
Quellenangaben
Volume: 271,
Article Number: 104885
Publisher
Elsevier
Publishing Place
525 B St, Ste 1900, San Diego, Ca 92101-4495 Usa
Institute(s)
Institute of AI for Health (AIH)
Grants
Hightech Agenda Bayern
European Research Council under the European Union
University of Udine project on "Piano Stretegico Dipartimentale on Artificial Intelligence" (PSD-AI)
FVG Project "Supporting the diagnosis of rare diseases (MR) through artificial intelligence"
European Research Council under the European Union
University of Udine project on "Piano Stretegico Dipartimentale on Artificial Intelligence" (PSD-AI)
FVG Project "Supporting the diagnosis of rare diseases (MR) through artificial intelligence"