Self-Policy Distillation extracts a capability subspace from model gradients on correctness tokens, projects KV activations into it for self-generation, and fine-tunes LLMs to achieve up to 13-16% gains over baselines without external signals.
Style over substance: Distilled language models reason via stylistic replication
3 Pith papers cite this work. Polarity classification is still indexing.
3
Pith papers citing it
fields
cs.CL 3representative citing papers
STOP uses structured on-policy analysis to prune long reasoning traces to their earliest correct node, cutting token usage 19-42% with little accuracy loss on math benchmarks.
By steering activations along directions learned from base-vs-fine-tuned disagreements, REFLEX reports 64.99 macro-F1 on RAW-FC fact-checking with only ~465 self-refined contrastive samples and no retrieval.
citing papers explorer
-
Self-Policy Distillation via Capability-Selective Subspace Projection
Self-Policy Distillation extracts a capability subspace from model gradients on correctness tokens, projects KV activations into it for self-generation, and fine-tunes LLMs to achieve up to 13-16% gains over baselines without external signals.
-
STOP: Structured On-Policy Pruning of Long-Form Reasoning in Low-Data Regimes
STOP uses structured on-policy analysis to prune long reasoning traces to their earliest correct node, cutting token usage 19-42% with little accuracy loss on math benchmarks.
-
REFLEX: Self-Refining Explainable Fact-Checking via Verdict-Anchored Style Control
By steering activations along directions learned from base-vs-fine-tuned disagreements, REFLEX reports 64.99 macro-F1 on RAW-FC fact-checking with only ~465 self-refined contrastive samples and no retrieval.