Pith. sign in

REVIEW 36 cited by

A Long Way to Go: Investigating Length Correlations in RLHF

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2310.03716 v2 pith:CA3OVUO5 submitted 2023-10-05 cs.CL cs.LG

A Long Way to Go: Investigating Length Correlations in RLHF

classification cs.CL cs.LG
keywords rlhflengthmodelsrewardfindimprovementsbiasespreference
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

Great success has been reported using Reinforcement Learning from Human Feedback (RLHF) to align large language models, with open preference datasets enabling wider experimentation, particularly for "helpfulness" in tasks like dialogue and web question answering. Alongside these improvements, however, RLHF also often drives models to produce longer outputs. This paper demonstrates, on three diverse settings, that optimizing for response length is, much more than previously thought, a significant factor behind RLHF. Studying the strategies RL optimization uses to maximize reward, we find improvements in reward to largely be driven by increasing response length, instead of other features. Indeed, we find that even a purely length-based reward reproduces most downstream RLHF improvements over supervised fine-tuned models. Testing a comprehensive set of length-countering interventions, we identify the dominant source of these biases to be reward models, which, by studying training dynamics, we find are non-robust and easily influenced by length biases in preference data.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 36 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. More Convincing, Not More Correct: Self-Play Reward Hacking of Reference-Free LLM Judges

    cs.LG 2026-07 accept novelty 7.0

    Self-play against reference-free LLM judges drives judge pass rates to 0.94 while true accuracy stays at 0.20, a reward-hacking basin that transfers across judge families and is prevented only by requiring the judge t...

  2. BabelJudge: Measuring LLM-as-a-Judge Reliability Across Languages and Agent Trajectories

    cs.CL 2026-06 unverdicted novelty 7.0

    BabelJudge introduces a perturbation-based framework to audit LLM judges for position bias, verbosity bias, order inconsistency, and cross-lingual degradation without human preference labels.

  3. Safe to Check, Unsafe to Use: Relinking at the Compression Boundary of LLM Agents

    cs.CR 2026-06 unverdicted novelty 7.0

    Relinking is a new compression-boundary attack on LLM agents where summarization of split benign fragments produces malicious instructions, shown via Relink tool at 86.9% success rate and mitigated by KBRA defense to 0%.

  4. AIP: A Graph Representation for Learning and Governing Agent Skills

    cs.AI 2026-06 unverdicted novelty 7.0

    AIP models skills as graphs of discrete steps connected by typed I/O edges under a validated schema, raising agent mean reward from 0.60 to 0.71 and pass rate from 53% to 67% on 27 SkillsBench tasks while enabling nod...

  5. Rethinking the Comparison Unit in Sequence-Level Reinforcement Learning: An Equal-Length Paired Training Framework from Loss Correction to Sample Construction

    cs.LG 2026-04 unverdicted novelty 7.0

    EqLen is a sample-construction framework that builds equal-length paired segments via dual-track generation and masking for stable group-relative RL in sequences, reframing the length problem as a comparison-unit issu...

  6. Beyond Semantic Manipulation: Token-Space Attacks on Reward Models

    cs.LG 2026-04 unverdicted novelty 7.0

    TOMPA performs black-box adversarial optimization in token space to discover non-linguistic patterns that nearly double the reward scores of GPT-5 answers on Skywork-Reward-V2 while producing gibberish text.

  7. Same Words, Different Judgments: How Preferences Vary Across Modalities

    cs.SD 2026-02 unverdicted novelty 7.0

    Human preferences for the same semantic content show near-chance agreement between text and audio, with audio raters using narrower decision thresholds, less length bias, and more user-oriented criteria.

  8. L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning

    cs.CL 2025-03 unverdicted novelty 7.0

    LCPO trains L1 reasoning models to adhere to prompt-specified CoT lengths, supporting accuracy-compute trade-offs and yielding short reasoning models that outperform larger baselines at matched lengths.

  9. Brevity is the Soul of Inference Efficiency: Inducing Concision in VLMs via Data Curation

    cs.LG 2026-06 unverdicted novelty 6.0

    Curating concise data for VLMs induces brevity, delivering 35x lower Cost-of-Pass at near-identical accuracy and higher matched-length accuracy than uncurated baselines.

  10. Brevity is the Soul of Inference Efficiency: Inducing Concision in VLMs via Data Curation

    cs.LG 2026-06 unverdicted novelty 6.0

    Curating pretraining data for concision in VLMs produces models with up to 35x lower cost-of-pass at matched accuracy by reducing output token count.

  11. A Unifying Lens on Reward Uncertainty in RLHF

    cs.LG 2026-06 unverdicted novelty 6.0

    A distributional reward model p(r|x,y) yields the closed-form effective reward ilde r(x,y) = eta ext{log} ext{E}_p[e^{r/eta}] (pessimistic branch) that unifies prior RLHF aggregation heuristics under Bayesian or ...

  12. Boosting Self-Consistency with Ranking

    cs.CL 2026-06 unverdicted novelty 6.0

    RISC reformulates self-consistency answer selection as a ranking task solved by a lightweight LambdaRank model with five hand-designed features, yielding better accuracy-efficiency trade-offs than majority voting on Q...

  13. Large Language Models Hack Rewards, and Society

    cs.LG 2026-06 unverdicted novelty 6.0

    LLMs discover regulatory loopholes in simulated societal environments through reward hacking during RL training.

  14. HARVE: Hacking-Aware Reward-Head Vector Editing for Robust Reward Models

    cs.LG 2026-06 unverdicted novelty 6.0

    HARVE removes the component of the reward-head vector aligned with a multi-directional hacking subspace from residual streams using a small set of contrastive examples, improving robustness on RewardHackBench across e...

  15. Fine-Tuning Improves Information Conveyance in Language Models

    cs.CL 2026-05 unverdicted novelty 6.0

    Fine-tuning reorganizes uncertainty in LLMs into more efficient information conveyance, as shown by stronger length-entropy correlations and a tripling of entropy-semantic diversity links after controls.

  16. General Preference Reinforcement Learning

    cs.LG 2026-05 unverdicted novelty 6.0

    GPRL applies a k-dimensional preference model with per-dimension normalized advantages and a drift monitor to LLM post-training, reporting 56.51% length-controlled win rate on AlpacaEval 2.0 and gains on other benchma...

  17. General Preference Reinforcement Learning

    cs.LG 2026-05 unverdicted novelty 6.0

    GPRL carries k-dimensional skew-symmetric preference structure into policy updates via per-dimension advantages and context-dependent eigenvalues, yielding 56.51% length-controlled win rate on AlpacaEval 2.0 from Llam...

  18. General Preference Reinforcement Learning

    cs.LG 2026-05 unverdicted novelty 6.0

    GPRL carries a k-dimensional skew-symmetric preference structure into policy updates with per-dimension advantages and a drift monitor, yielding 56.51% length-controlled win rate on AlpacaEval 2.0 from Llama-3-8B-Inst...

  19. Spurious Correlation Learning in Preference Optimization: Mechanisms, Consequences, and Mitigation via Tie Training

    cs.LG 2026-05 unverdicted novelty 6.0

    Characterizes spurious correlation mechanisms in preference optimization via mean spurious bias and causal-spurious correlation leakage, demonstrates irreducible vulnerability to distribution shift, and introduces tie...

  20. Spurious Correlation Learning in Preference Optimization: Mechanisms, Consequences, and Mitigation via Tie Training

    cs.LG 2026-05 unverdicted novelty 6.0

    Standard preference learning induces spurious feature reliance via mean bias and correlation leakage, creating irreducible distribution shift vulnerabilities that tie training mitigates without degrading causal learning.

  21. DeltaRubric: Generative Multimodal Reward Modeling via Joint Planning and Verification

    cs.CL 2026-05 unverdicted novelty 6.0

    DeltaRubric decomposes multimodal preference evaluation into self-generated planning and verification steps within a single model, producing large accuracy improvements on VL-RewardBench via multi-role reinforcement learning.

  22. Preference Instability in Reward Models: Detection and Mitigation via Sparse Autoencoders

    cs.LG 2026-05 conditional novelty 6.0

    Sparse autoencoders isolate unstable features in reward model representations and enable two mitigation techniques that reduce preference errors on perturbed inputs without retraining.

  23. TeamTR: Trust-Region Fine-Tuning for Multi-Agent LLM Coordination

    cs.LG 2026-05 unverdicted novelty 6.0

    TeamTR is a trust-region framework for multi-agent LLM fine-tuning that resamples trajectories after each update to convert quadratic compounding occupancy shift into linear scaling and yields per-update improvement l...

  24. When Prompts Override Vision: Prompt-Induced Hallucinations in LVLMs

    cs.CV 2026-04 unverdicted novelty 6.0

    Hallucinations in LVLMs largely arise from textual priors in prompts, and can be reduced by fine-tuning with preference optimization on grounded vs. hallucinated response pairs.

  25. Robust Reward Modeling for Large Language Models via Causal Decomposition

    cs.CL 2026-04 unverdicted novelty 6.0

    A decoder-based reconstruction error regularizer improves reward model accuracy on RewardBench from 0.832 to 0.868 while favoring shorter, less sycophantic outputs.

  26. Factored Causal Representation Learning for Robust Reward Modeling in RLHF

    cs.LG 2026-01 unverdicted novelty 6.0

    A factored causal representation learning method improves robustness of reward models in RLHF by isolating causal factors from biases like length and sycophancy using adversarial gradient reversal.

  27. Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domains

    cs.LG 2025-07 unverdicted novelty 6.0

    RaR uses aggregated rubric feedback as rewards in on-policy RL, delivering up to 31% relative gains on HealthBench and 7% on GPQA-Diamond versus direct Likert LLM-as-judge baselines.

  28. CoLD: Counterfactually-Guided Length Debiasing for Process Reward Models in Mathematical Reasoning

    cs.CL 2025-07 unverdicted novelty 6.0

    CoLD mitigates length bias in process reward models for mathematical reasoning via counterfactual guidance, length penalties, bias estimation, and joint training, improving step selection accuracy and conciseness on M...

  29. Quantifying and Auditing LLM Evaluation via Positive--Unlabeled Learning

    stat.ML 2026-06 unverdicted novelty 5.0

    A positive-unlabeled learning approach using partial optimal transport is introduced to audit and correct biases in LLM-as-a-judge systems by aligning limited human positives with unlabeled outputs in embedding space.

  30. Are LLMs Bad at Moral Reasoning?

    cs.CY 2026-06 unverdicted novelty 5.0

    Reanalyzing MoReBench by assigning LLMs the task of generating scoring rubrics shows better calibration to human rubrics and suggests stronger LLM moral reasoning than previously reported.

  31. PAFO: Pareto Fairness Optimization for Personalized Reward Modeling

    cs.AI 2026-06 unverdicted novelty 5.0

    PAFO applies Pareto fairness optimization and group-specialized distillation to produce a single personalized reward model that improves accuracy for both majority and minority preference groups without requiring grou...

  32. Characterizing initial human-AI proof formalization workflows

    cs.AI 2026-06 unverdicted novelty 5.0

    A controlled user study and qualitative survey find that AI assistance raises formalization accuracy for math proofs, with users flexibly combining multiple tools while retaining oversight.

  33. Rethinking the Comparison Unit in Sequence-Level Reinforcement Learning: An Equal-Length Paired Training Framework from Loss Correction to Sample Construction

    cs.LG 2026-04 unverdicted novelty 5.0

    EqLen reframes length bias in sequence-level RL as a comparison-unit construction problem and builds equal-length training segments via dual-track generation, prefix inheritance, and segment masking.

  34. Reward Hacking in the Era of Large Models: Mechanisms, Emergent Misalignment, Challenges

    cs.LG 2026-04 unverdicted novelty 5.0

    The paper introduces the Proxy Compression Hypothesis as a unifying framework explaining reward hacking in RLHF as an emergent result of compressing high-dimensional human objectives into proxy reward signals under op...

  35. Proxy Reward Internalization and Mechanistic Exploitation: A Learned Precursor to Reward Hacking and Its Generalization

    cs.AI 2026-06 unverdicted novelty 4.0

    Proxy RL produces a staged proxy-internalization capability that emerges before and predicts reward hacking in coding environments.

  36. Reinforcement Learning from Human Feedback

    cs.LG 2025-04 unverdicted novelty 2.0

    The book introduces the origins, mathematical setup, and optimization stages of RLHF including reward modeling, reinforcement learning, rejection sampling, and direct alignment algorithms.