BPE tokenizers trained on nine T2T primate genomes share only 11,569 of 512,000 tokens, and the vocabulary is dominated by short repeats rather than phylogenetic signal.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
q-bio.GN 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
When repeats drive the vocabulary: a Byte-Pair Encoding analysis of T2T primate genomes
BPE tokenizers trained on nine T2T primate genomes share only 11,569 of 512,000 tokens, and the vocabulary is dominated by short repeats rather than phylogenetic signal.