{"id":"511cbbbc-1bd3-4652-a975-42bf79065608","arxiv_id":"2611.08487","paper_version":1,"verdict":"CONDITIONAL","confidence":"MODERATE","novelty_score":5.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":7,"one_line_summary":"Sparse autoencoders decompose user embeddings into named behavioral modes that support zero-shot natural-language audience retrieval.","lead":"The authors show that user embeddings from recommender systems can be decomposed into a few interpretable behavioral modes using sparse autoencoders, and that the named modes support natural-language audience retrieval without any text-trained embeddings. The value for a generalist reader is a post-hoc, model-agnostic interpretability tool for personalization systems, supported by synthetic ground-truth recovery experiments and real-world retrieval benchmarks.","discovery_kind":"new_application","skeptic_critique":{"model":"deepseek/deepseek-v4-flash","headline":"The superposition claim rests on the Eq. (1) mixture assumption, which is never tested against real user behavior; synthetic validation generates data from that same assumption, and the real-data retrieval evidence does not by itself distinguish superposition from generic sparse coding.","rationale":"The reader's weakest-assumption analysis identifies the generative mixture model of Eq. (1) as the load-bearing premise, and my reading agrees: Eq. (2) is a consequence of that assumption, and the synthetic experiments are generated from it. The sharpening I add is that the real-data retrieval benchmarks are the only evidence for the assumption itself, and they do not settle it: K-Means encoding ties the SAE on the main MovieLens ranking metrics, the text baseline ties AUROC, and the demographic control is shared by all sparse-decomposition methods. I therefore frame the concern as an untested prediction of the framework rather than an internal inconsistency. The paper is unusually candid about its limitations, including the time-dependence suppression (b45–b46), the transformer linearity conjecture (b68), the single-seed Llama replication (b431), and the Stouffer independence caveat (b441). The proposed concrete test is feasible with data the authors already use: fit the SAE on one temporal snapshot and predict future raw category counts from mode weights. If modes are real generating mechanisms, recovered weights should predict held-out interactions; if a generic sparse code predicts equally well, the superposition claim is not falsified but its behavioral interpretation is unsupported. Because the paper is already CONDITIONAL and this concern is a sharpened condition (directly test Eq. (1) on real behavior) rather than a demonstrated failure, I do not change the verdict. The condition for acceptance should include this prediction test in addition to artifact release and the reader's proposed additional-domain validation.","tokens_in":31559,"tokens_out":5482,"duration_ms":43345,"concrete_test":"Test Eq. (1) directly on Open e-commerce by predicting held-out raw behavior from recovered mode weights. Fit the SAE on embeddings from pre-2021 windows only; for each user compute mode weights via SAE encoder activations; estimate each mode's category distribution p_k(c) from the interaction histories of its top-activating users; then predict each user's post-2021 category purchase counts as sum_k w_hat_k p_k(c). Compare predictive likelihood or R^2 against the same construction using K-Means encoding at matched L0 and against a dense baseline such as the full embedding. If the SAE modes do not predict held-out purchases substantially better than a generic sparse code, the discrete-mixture mechanism of Eq. (1) is not supported, and the recovered modes are best interpreted as embedding-space directions rather than verified behavioral generators.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The paper's central claim is Eq. (2): a user embedding is approximately the sparse weighted sum of mode centroids. As Section 3.1 states, this is a linearity-of-expectation consequence of the generative assumption in Eq. (1), not an independent empirical finding. The synthetic experiments in Section 4 exercise the implication in the direction the authors already proved: users are constructed with 2–6 modes drawn from the assumed mixture (Appendix A.1), embeddings are formed by mean-pooling, and the SAE sparsity is tuned to the known ground-truth mode count. Those experiments validate recovery of the assumed structure, not the existence of that structure in real behavior. The real-data experiments in Section 5 use zero-shot natural-language retrieval as the external test, but retrieval success does not require the discrete-mixture mechanism. On MovieLens, K-Means encoding, a generic partition-based sparse code with no mode assumption, ties the SAE on Lift and AUROC (Table 2, p≥0.1), and the text-embedding baseline ties AUROC; the SAE's advantages are coverage, scored AUROC, reconstruction fidelity, and feature distinctiveness. These outcomes are consistent with Eq. (1) but also with any sparse dictionary that captures enough ranking signal. The demographic control (Appendix E.3) shows that sparse decomposition captures demographic signal, but K-Means encoding also beat the text baseline there, so it does not isolate behavioral modes specifically. The load-bearing untested premise is therefore the one in sentences b47–b51: a small discrete set of behavioral modes exists, each user's interactions are i.i.d. draws from a sparse non-negative mixture over them, and time dependence can be suppressed (b45–b46). The authors acknowledge the time-dependence suppression and the nonlinear-encoder conjecture (b68), but no experiment in the paper tests whether real behavior is approximately generated this way.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek/deepseek-v4-flash","summary":"This paper argues that user embeddings can be understood as sparse superpositions of interpretable behavioral modes. Section 3 introduces a generative model (Eq. 1) in which each user's interactions are drawn i.i.d. from a sparse non-negative mixture of latent mode distributions, and derives Eq. (2): for mean-pooling embeddings, the user embedding is in expectation a sparse weighted sum of mode centroids. For transformer encoders the paper relies on an explicitly unproven linearity-in-w conjecture (Section 3.1), with all experiments mean-pooled. Section 4 tests, on synthetic data generated from Eq. (1) with known ground-truth modes, whether SAEs recover the modes from mean-pooled and SASRec-encoded embeddings; the SAE leads on code-to-ground-truth alignment and recovers 73 of 75 modes on transformer embeddings versus 59 percent for FastICA. Section 5 applies the pipeline to Open e-commerce and MovieLens: SAE latents are auto-interpreted by an LLM, and zero-shot natural-language audience retrieval is compared against K-Means encoding, FastICA, PCA, and a text-embedding baseline. On Open e-commerce the SAE wins or ties the classical baselines on Lift and AUROC; on MovieLens it ties K-Means on Lift and AUROC but wins on coverage, scored AUROC, reconstruction fidelity, and feature distinctiveness. Section 5.3 shows that SAE top-k feature sets are less redundant and cover more of the target audience.","tokens_in":31868,"tokens_out":21546,"duration_ms":132474,"significance":"The paper's empirical practice is a strength: multiple seeds with paired Wilcoxon tests reported in both directions (Table 10), an oracle ceiling bounding the synthetic comparison, a held-out demographic control (Appendix E.3), confidence-threshold and training-length sweeps (Tables 12 and 14), explicit disclosure of excluded tasks and queries (Appendices C.2 and E.2), and full prompts and query lists (Appendices E and F). The synthetic mode-recovery result on transformer-encoded embeddings (73 of 75 modes recovered versus 59 percent for FastICA, Appendix A.6) is strong evidence that, conditional on the mixture assumption, SAEs substantially outperform classical sparse baselines, and the direct comparison with the soft-frozen-decoder baseline of Korznikov et al. (2026) engages the central sanity-check criticism of SAEs. The demographic control does rule out the specific title-matching confound it targets (Appendix E.3). If the superposition hypothesis is treated as a working hypothesis with Eq. (1) as motivation, the paper delivers a practical, model-agnostic interpretability toolkit and a new test bed for mechanistic interpretability beyond transformer residual streams.","major_comments":[{"comment":"The existence of discrete behavioral-mode structure in real user behavior is assumed rather than tested, and the paper's validation strategy does not test that premise. The authors state in Section 3.1 that Eq. (2) is a linearity-of-expectation consequence of Eq. (1) for mean-pooling embeddings, so superposition for linear embeddings is not an independent empirical finding; the synthetic users are generated from exactly that assumption (Appendix A.1: 2 to 6 modes per user, LogNormal weights, interactions drawn from the mixture), and the SAE is additionally given the ground-truth sparsity through the adaptive L1 penalty (Appendix A.3). The authors acknowledge that this validates recovery 'under the framework's assumptions' (Section 4), but the abstract and the Section 5.1 headline present the structure as established. I ask for one of two fixes: (i) a direct, falsifiable test on real data, for example on Open e-commerce fitting LDA to the user-by-category counts and testing whether per-user SAE mode weights agree with LDA topic weights, or testing whether per-user SAE codes are sparse convex combinations whose residuals match mean-pooling noise; or (ii) an explicit reframing of the central claim as an interpretability and application claim with Eq. (1) as motivation, which is the register the paper already uses in parts of Section 5.2. The unproven linearity-in-w conjecture for transformer encoders (Section 3.1) is acknowledged by the authors, but it is part of the same gap, because the only test of the transformer extension runs on data generated from Eq. (1).","section":"Section 3, Eq. (1); Section 4, Appendix A.1","authors_acknowledge":"We conjecture that behavioral- mode resolution emerges from training dynamics, since the objective depends on aggregate sequence structure rather than individual items, but leave verification to future work.","authors_acknowledge_p":0.72},{"comment":"The real-data evaluation does not discriminate the discrete-mixture mechanism from generic sparse coding. On MovieLens, K-Means encoding is statistically indistinguishable from the SAE on the headline rank metrics (Table 10: Lift p=0.36 and 0.69, AUROC p=0.10 and 0.81 on SASRec and BERT4Rec), and the paper's explanation that 'the superposition structure is there for its centroids to approximate' (Section 5.2) presupposes the structure at issue. The SAE's advantages (coverage, scored AUROC on SASRec, reconstruction fidelity, feature distinctiveness) are consistent with any sparse dictionary that retains enough ranking signal, and the held-out demographic control (Appendix E.3) is also passed by K-Means encoding, so it isolates sparse decomposition generally rather than behavioral modes specifically. Consequently, the claim that 'SAE decomposition recovers the underlying behavioral modes faithfully enough to support zero-shot natural-language retrieval that matches or exceeds every classical sparse baseline on every retrieval-quality metric' (Section 5.1) is not established by retrieval evidence, and, as written, is contradicted in the same section: FastICA exceeds the SAE on Coverage in both Open e-commerce task blocks (Table 1: 0.770 versus 0.735 for category tasks; Appendix D reverse-direction p=0.91 and 0.97). Please either add a discriminative test (the LDA agreement test suggested above would serve) or rewrite the real-data claims so that faithful mode recovery is claimed only on synthetic data and the real-data contribution is framed as a useful, queryable feature representation.","section":"Section 5, Tables 1 and 2, Appendix E.3","authors_acknowledge":null,"authors_acknowledge_p":null}],"minor_comments":[{"comment":"The near-orthogonality of the SAE dictionary, cited in Section 5.2 as the driver of the coverage and redundancy advantages, is partly induced by the operating-point selection, since lambda is chosen at the elbow of mean pairwise decoder cosine similarity (Appendix E.1); the text should state explicitly that this orthogonality is a property of the selected operating point rather than an intrinsic SAE property.","section":"Section 5.2 and Appendix E.1","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The finding that part of the SAE's margin over the baselines comes from the LLM naming and selection step (with Llama 3.3 names, K-Means category coverage rises from 0.61 to 0.75 and the SAE's AUROC lead over K-Means falls from 0.031 to under 0.01, single seed, no significance test) appears only in the appendix; since it qualifies the headline comparison of Section 5.1, a one-sentence version of this caveat should appear in the main text.","section":"Appendix C.5 and Section 5.1","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The synthetic transformer experiment trains SASRec on shuffled histories because the generative model draws interactions independently (Appendix A.6); the main text should note this, since the MovieLens transformers are trained on chronological sequences, and the claim that mode recovery holds for transformer-encoded embeddings is demonstrated only for encoders applied to orderless sequences.","section":"Section 4 and Appendix A.6","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The term 'superposition' is used both for correlated non-orthogonal centroids and for overcomplete dictionaries in the sense of Elhage et al.; since these are different phenomena (correlated atoms versus more simultaneously active features than dimensions), a sentence separating them would help readers outside the mechanistic-interpretability literature.","section":"Section 3.1","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"The paper does not discuss identifiability of the dictionary learning problem in Eq. (2), that is, conditions under which the recovered atoms correspond to the true mode centroids rather than to another sparse dictionary spanning nearly the same subspace; the synthetic experiments provide empirical evidence, but a brief identifiability discussion would strengthen the theoretical framing.","section":"Section 3.2","authors_acknowledge":null,"authors_acknowledge_p":null},{"comment":"Minor copyediting: the reference to Spisak et al. contains a stray space in an author name; the footnote marker in the Section 5.1 headline sentence disrupts the claim; and the column formatting of Figure 2 should be cleaned up.","section":"Throughout","authors_acknowledge":null,"authors_acknowledge_p":null}],"recommendation":"major_revision"},"author_rebuttal":null,"desk_editor":{"model":"deepseek/deepseek-v4-flash","letter":"Two things to know before you read arXiv:2611.08487. First, the headline claim — user embeddings are sparse superpositions of interpretable behavioral modes — is a direct consequence of the paper's own generative mixture assumption (Eq. 1), not an independently established property of real embeddings. Second, the paper knows this and is unusually honest about it, which is why it's still worth reading: the real contribution is a disciplined demonstration that post-hoc SAE decomposition of user embeddings yields queryable, behaviorally distinct features and a zero-shot natural-language retrieval pipeline that works on embeddings never trained on text.\n\nWhat's actually new: SAEs have been applied to text, image, and other modality embeddings, but the combination here — decomposition of behavioral user embeddings, ground-truth mode recovery on synthetic transformer-encoded embeddings (73/75 modes vs. 59% for FastICA), and zero-shot NL audience retrieval with no text-aligned supervision — is new. The evaluation is a cut above the usual: paired Wilcoxon tests with reverse directions reported, oracle ceilings on synthetic data, a held-out demographic control where the title-text baseline collapses to near chance while the SAE holds AUROC 0.58–0.60, and explicit disclosure of excluded tasks, the single-seed Llama replication, and the conjecture status of the transformer extension (b68). The demographic control specifically rules out LLM title-matching as the explanation for the retrieval results.\n\nThe soft spots, in proportion. Eq. (2) is linearity of expectation applied to the paper's own mixture assumption; Section 3.1 and the Section 4 preamble say this, but the abstract and intro sell it as a finding. The synthetic experiments generate data from that same assumption and tune the SAE sparsity to the known ground-truth mode count, so the recovery numbers are partly guaranteed. And on real data, retrieval success does not separate the mode-superposition mechanism from generic sparse coding: K-Means encoding ties the SAE on the headline MovieLens ranking metrics, and the text baseline ties AUROC on title-derived tasks. The stress-test note is fair on all of this; I'd only add that the paper's own Section 4 explicitly frames synthetic validation as validation under the framework's assumptions, so the framing critique lands on the abstract more than on the body. Missing code and data, proprietary LLM steps, and modest absolute effect sizes round out the concerns; all disclosed, all real.\n\nWho this is for: people working on interpretability of user representations, recommendation auditing, and audience targeting, and anyone who wants a good example of honest SAE evaluation. It deserves a serious referee. I'd send it to review and condition acceptance on releasing artifacts, validating modes in a domain with different interaction semantics (negative feedback or mobility), and rewording the superposition claim so it matches what the evidence supports.","headline":"A disciplined, honest application of SAE dictionary learning to user embeddings whose superposition claim follows from its own mixture assumption; the real value is the retrieval pipeline and evaluation methodology, and the open question is whether real behavior has the assumed mode structure.","tokens_in":32626,"tokens_out":6430,"duration_ms":43551},"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek/deepseek-v4-flash","headline":"This paper argues that a user embedding is a sparse sum of a few interpretable behavioral modes, that sparse autoencoders recover them from the embedding alone, and that recovered modes enable zero-shot natural-language audience retrieval.","keywords":["sparse autoencoders","user embeddings","superposition hypothesis","behavioral modes","dictionary learning","interpretability","zero-shot audience retrieval","recommender systems"],"falsifier":"Generate synthetic user histories from a model with no discrete modes, for example each user's category propensities drawn from a smooth low-dimensional manifold and each purchase a softmax draw over those continuous propensities, then run the paper's exact pipeline (embed, mean-pool, SAE, LLM auto-interpretation) and check whether the recovered latents are stable across SAE training seeds and whether their LLM names track the manifold's true axes. The framework predicts stable, interpretable recovery; instability across seeds or names that track nothing in the generating process would falsify the superposition claim. A complementary real-data test is the paper's own held-out design: if SAE retrieval could not beat text-embedding baselines on labels the pipeline never saw (as it did for MovieLens demographics), the mode names would be an artifact of title matching rather than recovered behavior.","tokens_in":34911,"feed_emoji":"🧩","tokens_out":2944,"duration_ms":92111,"temperature":0.7,"pith_summary":"This paper tries to establish that the dense vector summarizing a user's history, the embedding a recommender computes, is actually a sparse superposition of a handful of behavioral modes such as \"dog lover,\" \"binge-watcher,\" or \"new parent.\" For any embedding built by averaging per-purchase vectors, that structure follows mathematically from a generative model in which each interaction is drawn from one of a few latent user types; for transformer encoders it is asserted approximately, via the superposition hypothesis, and tested empirically. The paper then shows that sparse autoencoders can pull the modes back out of the embedding alone, recovering 73 of 75 known modes on synthetic transformer-encoded users where the best classical baseline recovers 59 percent, and that LLM-named modes enable zero-shot natural-language audience search on real purchase and rating data. If true, this matters because it gives any pre-trained user embedding a transparent, queryable, and auditable representation without retraining or touching raw interaction logs.","feed_headline":"Decompose any user embedding into a few interpretable behavior modes","feed_subtitle":"Sparse dictionary learning recovers them, enabling natural-language audience search over any pre-trained user embedding.","key_machinery":"The load-bearing object is the superposition identity of Eq. (2), $u \\approx \\sum_k w_k d_k$: for mean-pooled embeddings, the user vector is approximately a sparse non-negative weighted sum of mode centroids, each centroid being the expected per-observation embedding of one behavioral mode. The recovery tool is the vanilla ReLU sparse autoencoder, whose encoder activations estimate mode weights and whose decoder columns estimate mode directions, with an L1 penalty enforcing sparsity and an overcomplete hidden dimension allowing non-orthogonal, superposed centroids to be disentangled, something PCA cannot do because its axes must be orthogonal. Around these two sit three supporting mechanisms: random projections or small embedding dimensions to vary the amount of superposition; a post-hoc merging step that recombines artificial feature splits, validated on synthetic data; and auto-interpretation, in which an LLM names each latent from its top-activating and non-activating users, turning recovered directions into natural-language features that can be scored against a query.","core_discovery":"The paper's central claim is that user embeddings are sparse superpositions of interpretable behavioral modes, not opaque dense vectors. For embeddings formed by averaging per-observation features (mean-pooling, possibly followed by a fixed linear map), this is exact in expectation: the user vector satisfies $u \\approx \\sum_k w_k d_k$, a sparse non-negative mixture over mode centroids $d_k$, where $w$ holds the user's mode weights from a mixed-membership generative model of behavior. The empirical claim is that a vanilla ReLU sparse autoencoder recovers those modes from the embeddings alone: on synthetic data with 75 known ground-truth modes it matches or exceeds every classical sparse baseline in the high-superposition regime $m < K$, and on transformer-encoded embeddings it recovers 73 of 75 modes where FastICA falls to 59 percent. On two real-world datasets, LLM-named SAE latents support zero-shot natural-language audience retrieval that matches or exceeds the classical sparse baselines and a text-embedding baseline on the metrics that measure top-of-ranking precision, and the near-orthogonal SAE dictionary covers audiences more fully than k-means encoding's overlapping centroids.","pith_inferences":["An untested extension of the paper's logic is that the same pipeline should work wherever an encoder uses a mean-pooled or linearly pooled readout, so mobility, financial, or health-engagement embeddings could be audited with no architectural change; the authors only demonstrated consumption domains.","The paper leaves its linearity-in-w conjecture for nonlinear encoders unverified; a direct test would run the synthetic mode-recovery task with a non-pooled readout (last-token or CLS) and compare recovery rates against the mean-pooled numbers.","A concrete design rule follows if the claim is right: recommenders that want post-hoc interpretability should prefer pooling readouts, since pooling provably preserves the superposition structure that SAEs can then recover.","The named-feature machinery suggests a quantitative privacy audit not run in the paper: measure how accurately a sensitive mode (e.g., recent new parent) can be inferred from embeddings alone before and after ablating its decoder direction."],"forward_implications":["Any mean-pooled or linearly pooled user embedding inherits the superposition structure whenever behavior follows a mixed-membership generative model, so mode recovery becomes a dictionary-learning problem solvable without modifying the upstream recommender.","Sparse autoencoders recover known ground-truth modes better than classical sparse baselines through a nonlinear transformer encoder (73 of 75 modes), so faithful mode recovery does not require a linear embedding function.","Zero-shot natural-language audience retrieval works on embeddings never trained on text, and beats a text-embedding baseline on Lift (precision at the top) while matching it on AUROC.","The near-orthogonal SAE dictionary describes an audience with more distinct concepts than k-means encoding's overlapping centroids, which paraphrase one region of embedding space and leave others uncovered.","Because recovered features are enumerable and named, sensitive trait directions can be detected and ablated, a capability the authors note also lowers the cost of privacy-invasive inference."],"supporting_citations":[{"why":"Supplies the superposition hypothesis and the sense in which non-orthogonal mode centroids live in superposition, motivating overcomplete dictionaries.","marker":"[Elhage et al., 2022]"},{"why":"Its LDA mixed-membership model is the discrete special case of Eq. (1), grounding the generative assumption about user behavior.","marker":"[Blei et al., 2003]"},{"why":"Establishes SAE dictionary learning and auto-interpretation of features from activating examples, and is cited for feature splitting.","marker":"[Bricken et al., 2023]"},{"why":"Shows SAEs extract human-interpretable features from model activations, the precedent this paper extends to user embeddings.","marker":"[Cunningham et al., 2024]"},{"why":"Supplies the random-projection technique used in synthetic experiments to vary the superposition dimension m.","marker":"[Bingham and Mannila, 2001]"},{"why":"Raises the criticism that SAEs can match random baselines; the paper's soft-frozen-decoder comparison answers it on synthetic data.","marker":"[Korznikov et al., 2026]"},{"why":"Defines k-means encoding, the strongest classical sparse baseline the SAE is compared against.","marker":"[Coates and Ng, 2012]"},{"why":"Supplies the Open e-commerce dataset with self-reported life-event labels used for real-data retrieval tests.","marker":"[Berke et al., 2024]"},{"why":"Supplies the MovieLens 1M dataset and its demographic labels used for transformer-embedding retrieval tests.","marker":"[Harper and Konstan, 2015]"},{"why":"Supplies SASRec, the transformer sequence encoder whose mean-pooled embeddings are decomposed in the synthetic and MovieLens experiments.","marker":"[Kang and McAuley, 2018]"}],"fun_headline_variants":["User embeddings are sparse mixes of nameable behavior modes","Sparse autoencoders pull interpretable behavior modes out of user embeddings","Plain-language queries target behavior modes hidden in user embeddings","User vectors are superpositions of interpretable behavioral modes","Sparse autoencoders expose user behavior modes, then name them"],"cache_read_input_tokens":0,"weakest_assumption_plain":"The load-bearing premise is that real user behavior is approximately generated by a small discrete set of behavioral modes, with each interaction drawn independently from a sparse non-negative mixture over them and time dependence ignorable, and, for transformer embeddings, that mode mixtures behave approximately linearly in the encoder's features (a conjecture the authors state but leave unverified); if either fails, the recovered and LLM-named modes are dictionary artifacts being labeled rather than recovered behavioral structure.","fun_headline_variants_meta":{"raw":{"variants":["User embeddings are sparse mixes of nameable behavior modes","Sparse autoencoders pull interpretable behavior modes out of user embeddings","Plain-language queries target behavior modes hidden in user embeddings","User vectors are superpositions of interpretable behavioral modes","Sparse autoencoders expose user behavior modes, then name them"]},"model":"deepseek/deepseek-v4-flash","effort":"low","cost_usd":0.000213,"raw_usage":{"cost":0.0002134132,"is_byok":false,"cost_details":{"upstream_inference_cost":0.0002134132,"upstream_inference_prompt_cost":2.85012e-05,"upstream_inference_completions_cost":0.000184912},"total_tokens":2074,"prompt_tokens":1058,"completion_tokens":1016,"prompt_tokens_details":{"audio_tokens":0,"video_tokens":0,"cached_tokens":931,"cache_write_tokens":0},"completion_tokens_details":{"audio_tokens":0,"image_tokens":0,"reasoning_tokens":945}},"tokens_in":1058,"tokens_out":1016,"cost_source":"openrouter_usage","duration_ms":9332,"image_pages":[],"temperature":1.0,"billed_attempts":1,"reasoning_tokens":945,"transport_provider":"openrouter","cache_read_input_tokens":0,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-11-06T06:00:50.571055+00:00","model_set":{"reader":"deepseek/deepseek-v4-flash"},"pipeline_version":"pith-pipeline@v1.4.1-daily-deepseek-or-medium","input_kind":null,"input_chars":null,"input_total_chars":null,"passes_missing":null,"published_standing":null,"published_confidence":null,"objection_audit":null,"run_record":null,"basis":{"kind":"not_recorded","source":null,"chars_given":null,"chars_total":null},"receipt":null,"falsifier":"Generate synthetic user histories from a model with no discrete modes, for example each user's category propensities drawn from a smooth low-dimensional manifold and each purchase a softmax draw over those continuous propensities, then run the paper's exact pipeline (embed, mean-pool, SAE, LLM auto-interpretation) and check whether the recovered latents are stable across SAE training seeds and whether their LLM names track the manifold's true axes. The framework predicts stable, interpretable recovery; instability across seeds or names that track nothing in the generating process would falsify the superposition claim. A complementary real-data test is the paper's own held-out design: if SAE retrieval could not beat text-embedding baselines on labels the pipeline never saw (as it did for MovieLens demographics), the mode names would be an artifact of title matching rather than recovered behavior.","supporting_citations":[],"lane_accuracy":{"status":"not yet measured","lane":{"model":"deepseek/deepseek-v4-flash","input_kind":null},"url":"https://pith.science/accuracy"},"review_version":1}