Masked-reconstruction transformers on single-cell RNA show power-law scaling with model size (α≈0.27) only in a data-rich regime; with few cells, scaling disappears.
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova
1 Pith paper cite this work, alongside 130 external citations. Polarity classification is still indexing.
1
Pith paper citing it
130
external citations · OpenAlex
fields
cs.LG 1years
2026 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Scaling Laws for Masked-Reconstruction Transformers on Single-Cell Transcriptomics
Masked-reconstruction transformers on single-cell RNA show power-law scaling with model size (α≈0.27) only in a data-rich regime; with few cells, scaling disappears.