Distinct Leaf Enumeration (DLE) replaces stochastic self-consistency sampling with deterministic traversal of a truncated decoding tree to enumerate distinct leaves, increasing coverage and reducing redundant computation while improving performance on math, coding, and reasoning benchmarks.
Stochastic Beams and Where to Find Them: The Gumbel-Top-k Trick for Sampling Sequences Without Replacement.arXiv preprint arXiv:1903.06059
2 Pith papers cite this work. Polarity classification is still indexing.
2
Pith papers citing it
abstract
The well-known Gumbel-Max trick for sampling from a categorical distribution can be extended to sample $k$ elements without replacement. We show how to implicitly apply this 'Gumbel-Top-$k$' trick on a factorized distribution over sequences, allowing to draw exact samples without replacement using a Stochastic Beam Search. Even for exponentially large domains, the number of model evaluations grows only linear in $k$ and the maximum sampled sequence length. The algorithm creates a theoretical connection between sampling and (deterministic) beam search and can be used as a principled intermediate alternative. In a translation task, the proposed method compares favourably against alternatives to obtain diverse yet good quality translations. We show that sequences sampled without replacement can be used to construct low-variance estimators for expected sentence-level BLEU score and model entropy.
citation-role summary
background 1
citation-polarity summary
years
2026 2verdicts
UNVERDICTED 2roles
background 1polarities
background 1representative citing papers
HI-NQS uses a dual-channel autoregressive Transformer NQS inside an iterative sample-diagonalize-update loop to reach chemical accuracy on small molecules and nitrogen active spaces with better determinant scaling than CIPSI.
citing papers explorer
-
Efficient Test-Time Inference via Deterministic Exploration of Truncated Decoding Trees
Distinct Leaf Enumeration (DLE) replaces stochastic self-consistency sampling with deterministic traversal of a truncated decoding tree to enumerate distinct leaves, increasing coverage and reducing redundant computation while improving performance on math, coding, and reasoning benchmarks.
-
An Iterative Dual-Channel Neural Quantum State Algorithm for Selected Configuration Interaction
HI-NQS uses a dual-channel autoregressive Transformer NQS inside an iterative sample-diagonalize-update loop to reach chemical accuracy on small molecules and nitrogen active spaces with better determinant scaling than CIPSI.