Pith. sign in

REVIEW 22 cited by

AxBench: Steering LLMs? Even Simple Baselines Outperform Sparse Autoencoders

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2501.17148 v3 pith:GV7UZRHY submitted 2025-01-28 cs.CL cs.AIcs.LG

classification cs.CLcs.AIcs.LG
keywords steeringfinetuningaxbenchpromptingautoencodersbenchmarkcompetitiveconcept
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Fine-grained steering of language model outputs is essential for safety and reliability. Prompting and finetuning are widely used to achieve these goals, but interpretability researchers have proposed a variety of representation-based techniques as well, including sparse autoencoders (SAEs), linear artificial tomography, supervised steering vectors, linear probes, and representation finetuning. At present, there is no benchmark for making direct comparisons between these proposals. Therefore, we introduce AxBench, a large-scale benchmark for steering and concept detection, and report experiments on Gemma-2-2B and 9B. For steering, we find that prompting outperforms all existing methods, followed by finetuning. For concept detection, representation-based methods such as difference-in-means, perform the best. On both evaluations, SAEs are not competitive. We introduce a novel weakly-supervised representational method (Rank-1 Representation Finetuning; ReFT-r1), which is competitive on both tasks while providing the interpretability advantages that prompting lacks. Along with AxBench, we train and publicly release SAE-scale feature dictionaries for ReFT-r1 and DiffMean.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 22 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. ODRA: Synthesizing Cognitive Behavioral Therapy Sessions with Structured Chain-Of-Thought and Dynamic Patient Resistance

    cs.CL 2026-08 conditional novelty 7.0 of 10

    ODRA synthesizes CBT sessions with a chain-of-thought CBT aligner and a dynamic patient resistance orchestrator, but its clinical robustness claims rest on evaluations using its own simulated patients.

  2. Retrieval is Enough: Training-Free Interpretability with a Tool-Using Agent

    cs.LG 2026-07 conditional novelty 7.0 of 10

    HARP shows that retrieval from an activation database plus linear-probe tools, driven by an LLM agent, matches or exceeds SAEs and activation oracles on four interpretability tasks with zero training.

  3. Aligned but Blind: Alignment Increases Implicit Bias by Reducing Awareness of Race

    cs.CL 2025-05 conditional novelty 7.0 of 10

    Alignment on Llama 3 reduces explicit bias but amplifies implicit bias, because aligned models no longer represent 'black' and 'white' as racial concepts in ambiguous contexts.

  4. Temporal Preference Concepts and their Functions in a Large Language Model

    cs.LG 2026-05 unverdicted novelty 6.5 of 10

    Temporal preference in Qwen3-4B-Instruct-2507 localizes to layers 17–35 (especially L24 attention), has curved residual-stream geometry, is behaviorally unstable, and can be bidirectionally steered.

  5. The SuperActivator Mechanism: Transformers Concentrate Reliable Concept Signals in the Tail

    cs.LG 2025-12 conditional novelty 6.0 of 10

    Reliable concept presence in transformers is concentrated in the extreme high-activation tail of in-concept tokens; thresholding that tail improves concept detection and localization.

  6. VISOR++: Universal Visual Inputs based Steering for Large Vision Language Models

    cs.CV 2025-09 conditional novelty 6.0 of 10

    A single adversarially optimized image can reproduce activation-steering behavior in multiple VLMs and partially transfer to unseen models.

  7. Sparse but Wrong: Incorrect L0 Leads to Incorrect Features in Sparse Autoencoders

    cs.LG 2025-08 conditional novelty 6.0 of 10

    Incorrect L0 makes sparse autoencoders mix correlated features rather than disentangling them, and a decoder projection metric can identify the correct L0.

  8. Insights into a radiology-specialised multimodal large language model with sparse autoencoders

    cs.LG 2025-07 conditional novelty 6.0 of 10

    Applying Matryoshka sparse autoencoders to a radiology-specialised multimodal LLM reveals a minority of interpretable clinical features, while steering them produces unreliable and often off-target report changes.

  9. Position: Use Sparse Autoencoders to Discover Unknowns

    cs.LG 2025-06 conditional novelty 6.0 of 10

    Sparse autoencoders are best used to discover unknown concepts, not to act on known concepts.

  10. Resa: Transparent Reasoning Models via SAEs

    cs.CL 2025-06 conditional novelty 6.0 of 10

    SAE-Tuning, a sparse-autoencoder-guided SFT procedure, elicits RL-comparable reasoning in 1.5B models from CoT-free QA data at about $1 and 20 minutes of training.

  11. Fine-Grained Interpretation of Political Opinions in Large Language Models

    cs.CL 2025-06 conditional novelty 6.0 of 10

    Four-dimensional political concept vectors learned from LLM internals can detect and partially steer political leanings better than a single left-right axis.

  12. HyperSteer: Activation Steering at Scale with Hypernetworks

    cs.CL 2025-06 conditional novelty 6.0 of 10

    A single hypernetwork trained on 16,000 steering prompts can produce working activation steering vectors for new, unseen prompts, beating per-concept ReFT-r1 and rivaling prompting.

  13. Improved Representation Steering for Language Models

    cs.CL 2025-05 conditional novelty 6.0 of 10

    RePS, a reference-free bidirectional preference optimization objective, improves representation steering and suppression for Gemma models, outperforming language-modeling objectives and approaching prompting performance.

  14. Steering Large Language Models for Machine Translation Personalization

    cs.CL 2025-05 conditional novelty 6.0 of 10

    Contrastive steering of sparse autoencoder features personalizes literary machine translation to a target translator's style as well as twenty-shot prompting while keeping inference fast.

  15. CircuitSteer: Geometrically Aligned Multi-Layer Steering via Sparse Autoencoder Circuits

    cs.LG 2026-08 reject novelty 5.0 of 10

    CircuitSteer builds cross-layer circuits from sparse autoencoder features using co-activation and decoder-direction alignment, then applies multi-layer steering vectors that it claims preserve fluency across all tested tasks.

  16. Investigating Symbolic Triggers of Hallucination in Gemma Models Across HaluEval and TruthfulQA

    cs.CL 2025-09 reject novelty 5.0 of 10

    Symbolic triggers like modifiers and named entities keep Gemma hallucination rates at 64-79% across model scales, suggesting larger models do not eliminate this failure mode.

  17. Sealing The Backdoor: Unlearning Adversarial Text Triggers In Diffusion Models Using Knowledge Distillation

    cs.CV 2025-08 unverdicted novelty 5.0 of 10

    SKD-CAG erases adversarial text triggers from diffusion models by distilling the model's own clean outputs through cross-attention guidance, claiming 100% and 93% removal for pixel and style backdoors.

  18. From Emergence to Control: Probing and Modulating Self-Reflection in Language Models

    cs.LG 2025-06 reject novelty 5.0 of 10

    Self-reflection in LLMs can be steered up or down by a single activation-space vector, improving accuracy when amplified and cutting output length when suppressed.

  19. Linear Representation Transferability Hypothesis: Leveraging Small Models to Steer Large Models

    cs.LG 2025-05 conditional novelty 5.0 of 10

    An affine map trained on The Pile transfers steering vectors from Gemma-2B to Gemma-9B and reproduces much of the large model's native steering behavior.

  20. Evaluating Steering Techniques using Human Similarity Judgments

    cs.AI 2025-05 conditional novelty 5.0 of 10

    Prompt-based steering outperformed activation-based steering on accuracy, but no method produced representations well aligned with human judgments, especially for size.

  21. Denoising Concept Vectors with Sparse Autoencoders for Improved Language Model Steering

    cs.CL 2025-05 conditional novelty 5.0 of 10

    Scaling up the most discriminative sparse autoencoder latents before reconstructing hidden states improves LLM concept steering vectors built by linear probing and difference-in-mean.

  22. Probabilistic Concept-Aware Steering for Trustworthy LLM Inference

    cs.AI 2026-05 reject novelty 4.0 of 10

    PCS improves steering direction accuracy by adaptively sampling the intervention coefficient from a cosine-similarity-conditioned Gaussian, but its evaluation is partly circular because the optimal coefficient is chos...

Pith tools