Periodic hidden special tokens that count remaining words during finetuning give LLMs accurate and extrapolatable output length control without hurting output quality.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Hansel: Output Length Controlling Framework for Large Language Models
Periodic hidden special tokens that count remaining words during finetuning give LLMs accurate and extrapolatable output length control without hurting output quality.