Pith. sign in

REVIEW 3 cited by

Efficient Reasoning Through Suppression of Self-Affirmation Reflections in Large Reasoning Models

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2506.12353 v1 pith:NZ4VGVGC submitted 2025-06-14 cs.CL cs.AI

classification cs.CLcs.AI
keywords reflectionsreasoningself-affirmationmodelslengthefficientanalysiscompression
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

While recent advances in large reasoning models have demonstrated remarkable performance, efficient reasoning remains critical due to the rapid growth of output length. Existing optimization approaches highlights a tendency toward "overthinking", yet lack fine-grained analysis. In this work, we focus on Self-Affirmation Reflections: redundant reflective steps that affirm prior content and often occurs after the already correct reasoning steps. Observations of both original and optimized reasoning models reveal pervasive self-affirmation reflections. Notably, these reflections sometimes lead to longer outputs in optimized models than their original counterparts. Through detailed analysis, we uncover an intriguing pattern: compared to other reflections, the leading words (i.e., the first word of sentences) in self-affirmation reflections exhibit a distinct probability bias. Motivated by this insight, we can locate self-affirmation reflections and conduct a train-free experiment demonstrating that suppressing self-affirmation reflections reduces output length without degrading accuracy across multiple models (R1-Distill-Models, QwQ-32B, and Qwen3-32B). Furthermore, we also improve current train-based method by explicitly suppressing such reflections. In our experiments, we achieve length compression of 18.7\% in train-free settings and 50.2\% in train-based settings for R1-Distill-Qwen-1.5B. Moreover, our improvements are simple yet practical and can be directly applied to existing inference frameworks, such as vLLM. We believe that our findings will provide community insights for achieving more precise length compression and step-level efficient reasoning.

Discussion (0). Sign in to comment.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Reconsidering Overthinking: Penalizing Internal and External Redundancy in CoT Reasoning

    cs.AI 2025-08 conditional novelty 6.0 of 10

    A dual-penalty RL method that compresses chain-of-thought traces by separately penalizing internal semantic stagnation and external post-answer continuation reduces reasoning length by about 40% while preserving accur...

  2. Failure Cases Are Better Learned But Boundary Says Sorry: Facilitating Smooth Perception Change for Accuracy-Robustness Trade-Off in Adversarial Training

    cs.CV 2025-08 reject novelty 5.0 of 10

    A paper whose abstract describes new adversarial training experiments, but whose full text is a different paper on CoT compression, leaving the claims unsupported.

  3. EDGE-GRPO: Entropy-Driven GRPO with Guided Error Correction for Advantage Diversity

    cs.AI 2025-07 conditional novelty 5.0 of 10

    EDGE-GRPO reduces advantage collapse in GRPO by injecting reference solutions into response groups and scaling advantages by policy entropy, achieving competitive math reasoning with only 1K training samples.

Pith tools