PuSH - Publication Server of Helmholtz Zentrum München

Transformers in single-cell omics: A review and new perspectives.

Nat. Methods 21, 1430-1443 (2024)
DOI PMC
Open Access Green as soon as Postprint is submitted to ZB.
Recent efforts to construct reference maps of cellular phenotypes have expanded the volume and diversity of single-cell omics data, providing an unprecedented resource for studying cell properties. Despite the availability of rich datasets and their continued growth, current single-cell models are unable to fully capitalize on the information they contain. Transformers have become the architecture of choice for foundation models in other domains owing to their ability to generalize to heterogeneous, large-scale datasets. Thus, the question arises of whether transformers could set off a similar shift in the field of single-cell modeling. Here we first describe the transformer architecture and its single-cell adaptations and then present a comprehensive review of the existing applications of transformers in single-cell analysis and critically discuss their future potential for single-cell biology. By studying limitations and technical challenges, we aim to provide a structured outlook for future research directions at the intersection of machine learning and single-cell biology.
Altmetric
Additional Metrics?
Edit extra informations Login
Publication type Article: Journal article
Document type Review
Corresponding Author
ISSN (print) / ISBN 1548-7091
e-ISSN 1548-7105
Journal Nature Methods
Quellenangaben Volume: 21, Issue: 8, Pages: 1430-1443 Article Number: , Supplement: ,
Publisher Nature Publishing Group
Publishing Place New York, NY
Non-patent literature Publications
Reviewing status Peer reviewed