Nucleus sampling draws from the smallest set of tokens whose cumulative probability exceeds threshold p, yielding more human-like diversity and coherence than beam search or full-distribution sampling.
Steven T Piantadosi
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2019 1verdicts
ACCEPT 1representative citing papers
citing papers explorer
-
The Curious Case of Neural Text Degeneration
Nucleus sampling draws from the smallest set of tokens whose cumulative probability exceeds threshold p, yielding more human-like diversity and coherence than beam search or full-distribution sampling.