PuSH - Publication Server of Helmholtz Zentrum München

Export: TXT Text RIS Endnote (RIS) BIB BibTeX
Richter, T. ; Bahrami, M. ; Xia, Y.* ; Fischer, D.S. ; Theis, F.J.

Delineating the effective use of self-supervised learning in single-cell genomics.

Nat. Mach. Intell., DOI: 10.1038/s42256-024-00934-3 (2025)
Publ. Version/Full Text DOI
Open Access Hybrid
Creative Commons Lizenzvertrag
Self-supervised learning (SSL) has emerged as a powerful method for extracting meaningful representations from vast, unlabelled datasets, transforming computer vision and natural language processing. In single-cell genomics (SCG), representation learning offers insights into the complex biological data, especially with emerging foundation models. However, identifying scenarios in SCG where SSL outperforms traditional learning methods remains a nuanced challenge. Furthermore, selecting the most effective pretext tasks within the SSL framework for SCG is a critical yet unresolved question. Here we address this gap by adapting and benchmarking SSL methods in SCG, including masked autoencoders with multiple masking strategies and contrastive learning methods. Models trained on over 20 million cells were examined across multiple downstream tasks, including cell-type prediction, gene-expression reconstruction, cross-modality prediction and data integration. Our empirical analyses underscore the nuanced role of SSL, namely, in transfer learning scenarios leveraging auxiliary data or analysing unseen datasets. Masked autoencoders excel over contrastive methods in SCG, diverging from computer vision trends. Moreover, our findings reveal the notable capabilities of SSL in zero-shot settings and its potential in cross-modality prediction and data integration. In summary, we study SSL methods in SCG on fully connected networks and benchmark their utility across key representation learning scenarios.
Impact Factor
Scopus SNIP
Altmetric
23.900
0.000
Tags
Annotations
Special Publikation
Hide on homepage

Edit extra information
Edit own tags
Private
Edit own annotation
Private
Hide on publication lists
on hompage
Mark as special
publikation
Publication type Article: Journal article
Document type Scientific Article
Language english
Publication Year 2025
Prepublished in Year 2024
HGF-reported in Year 2024
ISSN (print) / ISBN 2522-5839
e-ISSN 2522-5839
Journal Nature machine intelligence
Publisher Springer
Publishing Place [London]
Reviewing status Peer reviewed
Institute(s) Institute of Computational Biology (ICB)
POF-Topic(s) 30205 - Bioengineering and Digital Health
Research field(s) Enabling and Novel Technologies
PSP Element(s) G-503800-001
DOI 10.1038/s42256-024-00934-3
Scopus ID 85213204349
Erfassungsdatum 2025-01-10
[➜Report correction]