Introduces Dual Steering via Gram-Schmidt orthogonalization to reduce interference in multi-attribute activation steering for the Multitrack Music Transformer.
Adaptive Activation Steering for Efficient LLM Reasoning via Closed-Loop PID Control
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Reasoning LLMs trained with long chain-of-thought often overthink: they spend tokens on redundant reflection and transitions that inflate cost without improving accuracy. Static activation steering (e.g.\ SEAL) suppresses such content with a fixed vector, but applies the same strength regardless of how redundant the current chunk actually is. We describe PID-steering, a training-free, decoding-time method that modulates the steering strength with a PID controller driven by a lightweight chunk-level redundancy classifier. On a subset of GSM8K with DeepSeek-R1-Distill-Qwen-1.5B, the method improves accuracy from 85.7\% to 89.6\% (+3.9 pp) while cutting average output length from 1026 to 790 tokens ($-$23\%). We report it as a small-scale proof of concept rather than a benchmark result.
fields
cs.SD 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
Closing the Loop: PID Feedback Control for Interpretable Activation Steering in Symbolic Music Generation
Introduces Dual Steering via Gram-Schmidt orthogonalization to reduce interference in multi-attribute activation steering for the Multitrack Music Transformer.