REVIEW 22 cited by
AxBench: Steering LLMs? Even Simple Baselines Outperform Sparse Autoencoders
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Fine-grained steering of language model outputs is essential for safety and reliability. Prompting and finetuning are widely used to achieve these goals, but interpretability researchers have proposed a variety of representation-based techniques as well, including sparse autoencoders (SAEs), linear artificial tomography, supervised steering vectors, linear probes, and representation finetuning. At present, there is no benchmark for making direct comparisons between these proposals. Therefore, we introduce AxBench, a large-scale benchmark for steering and concept detection, and report experiments on Gemma-2-2B and 9B. For steering, we find that prompting outperforms all existing methods, followed by finetuning. For concept detection, representation-based methods such as difference-in-means, perform the best. On both evaluations, SAEs are not competitive. We introduce a novel weakly-supervised representational method (Rank-1 Representation Finetuning; ReFT-r1), which is competitive on both tasks while providing the interpretability advantages that prompting lacks. Along with AxBench, we train and publicly release SAE-scale feature dictionaries for ReFT-r1 and DiffMean.
Forward citations
Cited by 22 Pith papers
-
ODRA: Synthesizing Cognitive Behavioral Therapy Sessions with Structured Chain-Of-Thought and Dynamic Patient Resistance
ODRA synthesizes CBT sessions with a chain-of-thought CBT aligner and a dynamic patient resistance orchestrator, but its clinical robustness claims rest on evaluations using its own simulated patients.
-
Retrieval is Enough: Training-Free Interpretability with a Tool-Using Agent
HARP shows that retrieval from an activation database plus linear-probe tools, driven by an LLM agent, matches or exceeds SAEs and activation oracles on four interpretability tasks with zero training.
-
Aligned but Blind: Alignment Increases Implicit Bias by Reducing Awareness of Race
Alignment on Llama 3 reduces explicit bias but amplifies implicit bias, because aligned models no longer represent 'black' and 'white' as racial concepts in ambiguous contexts.
-
Temporal Preference Concepts and their Functions in a Large Language Model
Temporal preference in Qwen3-4B-Instruct-2507 localizes to layers 17–35 (especially L24 attention), has curved residual-stream geometry, is behaviorally unstable, and can be bidirectionally steered.
-
The SuperActivator Mechanism: Transformers Concentrate Reliable Concept Signals in the Tail
Reliable concept presence in transformers is concentrated in the extreme high-activation tail of in-concept tokens; thresholding that tail improves concept detection and localization.
-
VISOR++: Universal Visual Inputs based Steering for Large Vision Language Models
A single adversarially optimized image can reproduce activation-steering behavior in multiple VLMs and partially transfer to unseen models.
-
Sparse but Wrong: Incorrect L0 Leads to Incorrect Features in Sparse Autoencoders
Incorrect L0 makes sparse autoencoders mix correlated features rather than disentangling them, and a decoder projection metric can identify the correct L0.
-
Insights into a radiology-specialised multimodal large language model with sparse autoencoders
Applying Matryoshka sparse autoencoders to a radiology-specialised multimodal LLM reveals a minority of interpretable clinical features, while steering them produces unreliable and often off-target report changes.
-
Position: Use Sparse Autoencoders to Discover Unknowns
Sparse autoencoders are best used to discover unknown concepts, not to act on known concepts.
-
Resa: Transparent Reasoning Models via SAEs
SAE-Tuning, a sparse-autoencoder-guided SFT procedure, elicits RL-comparable reasoning in 1.5B models from CoT-free QA data at about $1 and 20 minutes of training.
-
Fine-Grained Interpretation of Political Opinions in Large Language Models
Four-dimensional political concept vectors learned from LLM internals can detect and partially steer political leanings better than a single left-right axis.
-
HyperSteer: Activation Steering at Scale with Hypernetworks
A single hypernetwork trained on 16,000 steering prompts can produce working activation steering vectors for new, unseen prompts, beating per-concept ReFT-r1 and rivaling prompting.
-
Improved Representation Steering for Language Models
RePS, a reference-free bidirectional preference optimization objective, improves representation steering and suppression for Gemma models, outperforming language-modeling objectives and approaching prompting performance.
-
Steering Large Language Models for Machine Translation Personalization
Contrastive steering of sparse autoencoder features personalizes literary machine translation to a target translator's style as well as twenty-shot prompting while keeping inference fast.
-
CircuitSteer: Geometrically Aligned Multi-Layer Steering via Sparse Autoencoder Circuits
CircuitSteer builds cross-layer circuits from sparse autoencoder features using co-activation and decoder-direction alignment, then applies multi-layer steering vectors that it claims preserve fluency across all tested tasks.
-
Investigating Symbolic Triggers of Hallucination in Gemma Models Across HaluEval and TruthfulQA
Symbolic triggers like modifiers and named entities keep Gemma hallucination rates at 64-79% across model scales, suggesting larger models do not eliminate this failure mode.
-
Sealing The Backdoor: Unlearning Adversarial Text Triggers In Diffusion Models Using Knowledge Distillation
SKD-CAG erases adversarial text triggers from diffusion models by distilling the model's own clean outputs through cross-attention guidance, claiming 100% and 93% removal for pixel and style backdoors.
-
From Emergence to Control: Probing and Modulating Self-Reflection in Language Models
Self-reflection in LLMs can be steered up or down by a single activation-space vector, improving accuracy when amplified and cutting output length when suppressed.
-
Linear Representation Transferability Hypothesis: Leveraging Small Models to Steer Large Models
An affine map trained on The Pile transfers steering vectors from Gemma-2B to Gemma-9B and reproduces much of the large model's native steering behavior.
-
Evaluating Steering Techniques using Human Similarity Judgments
Prompt-based steering outperformed activation-based steering on accuracy, but no method produced representations well aligned with human judgments, especially for size.
-
Denoising Concept Vectors with Sparse Autoencoders for Improved Language Model Steering
Scaling up the most discriminative sparse autoencoder latents before reconstructing hidden states improves LLM concept steering vectors built by linear probing and difference-in-mean.
-
Probabilistic Concept-Aware Steering for Trustworthy LLM Inference
PCS improves steering direction accuracy by adaptively sampling the intervention coefficient from a cosine-similarity-conditioned Gaussian, but its evaluation is partly circular because the optimal coefficient is chos...
Discussion (0). Continue with ORCID to comment.