Gated SAEs decouple which features to use from how large their activations should be, applying the L1 penalty only to selection and thereby eliminating shrinkage while halving the number of firing features needed for good fidelity.
Title resolution pending
2 Pith papers cite this work. Polarity classification is still indexing.
2
Pith papers citing it
representative citing papers
Linear probes on frozen LLM hidden states recover an approximate remaining-output-length signal that is decodable at prompt-end, transfers across datasets, and shifts upward at retraction tokens.
citing papers explorer
-
Improving Dictionary Learning with Gated Sparse Autoencoders
Gated SAEs decouple which features to use from how large their activations should be, applying the L1 penalty only to selection and thereby eliminating shrinkage while halving the number of firing features needed for good fidelity.
-
How Much is Left? LLMs Linearly Encode Their Remaining Output Length
Linear probes on frozen LLM hidden states recover an approximate remaining-output-length signal that is decodable at prompt-end, transfers across datasets, and shifts upward at retraction tokens.