On four minimal graph-construction tasks, multi-token training (teacherless or diffusion) produces more diverse and original outputs than next-token training, and random seed prefixes can replace temperature as a diversity knob.
logically correct
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction
On four minimal graph-construction tasks, multi-token training (teacherless or diffusion) produces more diverse and original outputs than next-token training, and random seed prefixes can replace temperature as a diversity knob.