Pith. sign in

REVIEW 45 cited by

Studying Large Language Model Generalization with Influence Functions

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2308.03296 v1 pith:O5Z5Q3FW submitted 2023-08-07 cs.LG cs.CLstat.ML

Studying Large Language Model Generalization with Influence Functions

classification cs.LG cs.CLstat.ML
keywords influencefunctionsgeneralizationllmsmodelscaletrainingbehavior
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

When trying to gain better visibility into a machine learning model in order to understand and mitigate the associated risks, a potentially valuable source of evidence is: which training examples most contribute to a given behavior? Influence functions aim to answer a counterfactual: how would the model's parameters (and hence its outputs) change if a given sequence were added to the training set? While influence functions have produced insights for small models, they are difficult to scale to large language models (LLMs) due to the difficulty of computing an inverse-Hessian-vector product (IHVP). We use the Eigenvalue-corrected Kronecker-Factored Approximate Curvature (EK-FAC) approximation to scale influence functions up to LLMs with up to 52 billion parameters. In our experiments, EK-FAC achieves similar accuracy to traditional influence function estimators despite the IHVP computation being orders of magnitude faster. We investigate two algorithmic techniques to reduce the cost of computing gradients of candidate training sequences: TF-IDF filtering and query batching. We use influence functions to investigate the generalization patterns of LLMs, including the sparsity of the influence patterns, increasing abstraction with scale, math and programming abilities, cross-lingual generalization, and role-playing behavior. Despite many apparently sophisticated forms of generalization, we identify a surprising limitation: influences decay to near-zero when the order of key phrases is flipped. Overall, influence functions give us a powerful new tool for studying the generalization properties of LLMs.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 45 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Emergent Misalignment Recruits a Pre-existing Persona Subspace

    cs.LG 2026-07 conditional novelty 7.0

    Fine-tuning on narrow bad data recruits a low-rank persona subspace already present in a frozen instruction-tuned model; holding that subspace out of activations prevents broad misalignment, and injecting it into the ...

  2. Domain-Aware Scaling Laws Uncover Data Synergy

    cs.LG 2026-07 conditional novelty 7.0

    Domain-aware scaling laws with fitted γ and σ synergy terms recover stable code-math interactions from observational LLM mixtures and correctly predict mixture rankings in controlled small-scale trainings.

  3. What's a Credit Worth? A Market Framework for Attribution-Aware Compensation in Generative Music

    cs.CY 2026-07 conditional novelty 7.0

    Proposes an attribution-aware compensation framework for generative music that derives closed-form payments from catalog-level attribution informativeness and quantifies welfare effects under competition.

  4. Symbolic Mechanistic Data Attribution: Tracing Training Influence to Learned Behavioral Policies

    cs.LG 2026-06 unverdicted novelty 7.0

    SMDA fits ridge regression on SAE features to distill symbolic policies then decomposes each SFT example's influence via feature-activation and output-probability deltas, demonstrated on refusal behavior in Llama-3.2-...

  5. Finding Most Influential Sets

    stat.ML 2026-06 unverdicted novelty 7.0

    For linear-fractional leave-set-out estimands, most influential set selection reduces to a one-parameter sequence of top-k problems solved efficiently by Dinkelbach's algorithm with global optimality for fixed residuals.

  6. CurveRL: Principled Distribution-Aware Context Reweighting for LLM Reasoning

    cs.LG 2026-05 unverdicted novelty 7.0

    CurveRL derives a quantile-coordinate reweighting rule from a utility functional on pass rates and shows it outperforms GRPO on reasoning benchmarks.

  7. How Faithful Is Trajectory-Based Data Attribution? Error Sources, Remedies, and Practical Guidelines

    cs.LG 2026-05 conditional novelty 7.0

    The paper decomposes errors in trajectory-based data attribution into config, algorithm, and system levels, proposes AdamW-influence to fix optimizer mismatch, derives an error proxy for Taylor approximation, and unif...

  8. Filter-then-Weight: Online Data Selection and Reweighting for LLM Fine-Tuning

    cs.LG 2026-03 unverdicted novelty 7.0

    Filter-then-Weight is a two-stage optimizer-aware method that filters geometrically useful data candidates and optimizes their coefficients to shape target updates in online LLM fine-tuning.

  9. On the Expressive Power of Permutation-Equivariant Weight-Space Networks

    cs.LG 2026-02 conditional novelty 7.0

    Permutation-equivariant weight-space networks are all equally expressive, and universality holds when hidden-layer biases are pairwise distinct.

  10. On the Accuracy of Newton Step and Influence Function Data Attributions

    cs.LG 2025-12 unverdicted novelty 7.0

    New analysis without global strong convexity yields tight scaling laws: NS error ~Θ(kd/n²) and NS-IF difference ~Θ((k+d)√(kd)/n²) for well-behaved logistic regressions.

  11. Influence Dynamics and Stagewise Data Attribution

    cs.LG 2025-10 conditional novelty 7.0

    Using Bayesian influence functions and singular learning theory, the authors show that a sample's influence on a model varies non-monotonically over training, peaking and flipping sign at phase transitions.

  12. MIMIC: Multimodal Inversion for Model Interpretation and Conceptualization

    cs.CV 2025-08 unverdicted novelty 7.0

    MIMIC is a new inversion framework that recovers visual concepts from VLM internal states using joint inversion, feature alignment, and three regularizers.

  13. Tracing LLM Behavior to the Training Data with Empirical Next-Token Distributions

    cs.AI 2026-07 conditional novelty 6.0

    Across Pythia models, a large fraction of training contexts are predicted almost exactly by the empirical next-token distribution of the corpus, but frequent high-entropy contexts remain poorly matched.

  14. Tracing LLM Behavior to the Training Data with Empirical Next-Token Distributions

    cs.AI 2026-07 conditional novelty 6.0

    A trained transformer's next-token distribution often matches the empirical next-token distribution of its pretraining corpus, with agreement improving as models grow, while a persistent tail of mismatches remains.

  15. Prototype Language Models

    cs.LG 2026-07 unverdicted novelty 6.0

    PRISM forms predictions as sparse mixtures of learned prototypes trained with clustering objectives, matching dense model accuracy while enabling ~500x faster data attribution and behavior editing without finetuning.

  16. Quantifying the Agreement Between Data-Influence and Data-Similarity to Understand LLM Behavior

    cs.LG 2026-06 unverdicted novelty 6.0

    Data-similarity and data-influence produce significantly overlapping rankings of training documents for LLM outputs, with asymmetry allowing a favorable cost-accuracy trade-off.

  17. DRIFT: Refining Instruction Data via On-Policy Data Attribution

    cs.LG 2026-06 unverdicted novelty 6.0

    DRIFT applies on-policy influence functions with signed weighting and debiasing to attribute and refine SFT data, raising performance on 7B instruction and reasoning models over prior curation methods.

  18. Validity Threats for Foundation Model Research

    cs.LG 2026-06 accept novelty 6.0

    Maps common low-compute research strategies for foundation models onto statistical, internal, external, and construct validity threats via a causal-inference lens.

  19. Consistency Training while Mitigating Obfuscation via Rate Matching

    cs.CL 2026-06 unverdicted novelty 6.0

    RMCT matches the rate of target behaviors like bias-following across input perturbations to reduce sycophancy in LLMs while preserving verbalization of bias cues.

  20. Detectability in Diversity: Improved Canary Crafting for Privacy Auditing in One Run

    cs.LG 2026-05 unverdicted novelty 6.0

    New canary crafting via greedy influence-based init and bilevel optimization for diversity in embedding space yields stronger one-run privacy leakage estimates at lower cost.

  21. Interaction-Aware Influence Functions for Group Attribution

    cs.LG 2026-05 conditional novelty 6.0

    Extends influence functions with a second-order pairwise interaction term that improves group attribution accuracy over simple summation on multiple model-dataset pairs and instruction-tuning selection tasks.

  22. Correcting Influence: Unboxing LLM Outputs with Orthogonal Latent Spaces

    cs.LG 2026-05 unverdicted novelty 6.0

    A latent mediation framework with sparse autoencoders enables non-additive token-level influence attribution in LLMs by learning orthogonal features and back-propagating attributions.

  23. Convergent Evolution: How Different Language Models Learn Similar Number Representations

    cs.CL 2026-04 unverdicted novelty 6.0

    Diverse language models converge on similar periodic number features with a two-tier hierarchy of Fourier sparsity and geometric separability, acquired via language co-occurrences or multi-token arithmetic.

  24. Mechanistic Anomaly Detection via Functional Attribution

    cs.LG 2026-04 unverdicted novelty 6.0

    Functional attribution with influence functions detects anomalous mechanisms in neural networks, achieving SOTA backdoor detection (average DER 0.93) on vision benchmarks and improvements on LLMs.

  25. Representation-Guided Parameter-Efficient LLM Unlearning

    cs.CL 2026-04 unverdicted novelty 6.0

    REGLU guides LoRA-based unlearning via representation subspaces and orthogonal regularization to outperform prior methods on forget-retain trade-off in LLM benchmarks.

  26. Sketching the Readout of Large Language Models for Scalable Data Attribution and Valuation

    cs.LG 2026-04 conditional novelty 6.0

    Influence scoring can use only forward passes: CountSketch-compressed outer products of the LM-head residual and final hidden state give accurate attribution and valuation from 14M to 32B parameters.

  27. Sketching the Readout of Large Language Models for Scalable Data Attribution and Valuation

    cs.LG 2026-04 unverdicted novelty 6.0

    RISE applies CountSketch to dual lexical and semantic channels derived from output-layer gradient outer products, cutting data attribution storage by up to 112x and enabling retrospective and prospective influence ana...

  28. What Exactly do Children Receive in Language Acquisition? A Case Study on CHILDES with Automated Detection of Filler-Gap Dependencies

    cs.CL 2026-03 conditional novelty 6.0

    An automated parser-based detector labels wh-questions and relative clauses with extraction sites in CHILDES, revealing object-biased questions but balanced relative clauses, and shows matrix questions drive LM genera...

  29. GradAlign: Gradient-Aligned Data Selection for LLM Reinforcement Learning

    cs.LG 2026-02 reject novelty 6.0

    GradAlign selects RL training problems whose policy gradients align with validation-set gradients, claiming more stable and better-performing LLM post-training.

  30. A Critical Look at Targeted Instruction Selection: Disentangling What Matters (and What Doesn't)

    cs.LG 2026-02 conditional novelty 6.0

    Only gradient-based (LESS) representations make subset-to-query distance a reliable predictor of instruction-tuning performance; greedy round-robin helps most at small budgets, and random selection is surprisingly com...

  31. A Human-Centric Framework for Data Attribution in Large Language Models

    cs.CY 2026-02 unverdicted novelty 6.0

    Introduces a parameter-driven framework for data attribution in LLMs that enables negotiation among creators, users, and intermediaries to meet stakeholder goals within the data economy.

  32. Efficient Estimation of Kernel Surrogate Models for Task Attribution

    cs.LG 2026-02 unverdicted novelty 6.0

    Kernel surrogate models with first-order gradient approximation achieve 25% higher correlation to leave-one-out ground truth for task attribution and 40% better downstream data selection than linear surrogates.

  33. Which Reasoning Trajectories Teach Students to Reason Better? A Simple Metric of Informative Alignment

    cs.CL 2026-01 conditional novelty 6.0

    Rank-Surprisal Ratio (RSR) correlates strongly (average Spearman 0.86) with post-distillation reasoning gains across five student models and trajectories from eleven teachers, outperforming existing selection metrics.

  34. AfroScope: A Framework for Studying the Linguistic Landscape of Africa

    cs.CL 2026-01 conditional novelty 6.0

    A new framework combines a 713-language African LID dataset, strong baselines, and a contrastive-embedding hierarchical step that improves macro-F1 by 4.55 on a 29-language confusable subset.

  35. LLM generation novelty through the lens of semantic similarity

    cs.LG 2025-10 conditional novelty 6.0

    An output is called novel when no semantically similar pretraining context can be retrieved; using this embedding-based measure, SmolLM models show longer-range reuse and instruction tuning increases novelty.

  36. Feature Identification via the Empirical NTK

    cs.LG 2025-10 unverdicted novelty 6.0

    Eigenanalysis of the empirical NTK surfaces feature directions that align with Fourier features in modular addition networks and grammatical features in Gemma-3-270M, outperforming PCA baselines on activations.

  37. DMin: Scalable Training Data Influence Estimation for Diffusion Models

    cs.CV 2024-12 unverdicted novelty 6.0

    DMin uses gradient compression to scalably estimate training data influence in billion-parameter diffusion models.

  38. SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generation

    cs.LG 2023-10 conditional novelty 6.0

    SalUn uses gradient-based weight saliency to achieve effective machine unlearning of data, classes, or concepts in image classification and generation, narrowing the gap to exact retraining.

  39. Dataset Distillation by Influence Matching

    cs.CV 2026-07 reject novelty 5.0

    Inf-Match distills datasets by matching estimated parameter influence of real and synthetic data, reporting SOTA classification and retrieval, but with an unsupported theoretical core.

  40. Which Reasoning Trajectories Teach Students to Reason Better? A Simple Metric of Informative Alignment

    cs.CL 2026-01 conditional novelty 5.0

    A trajectory for student-LLM distillation is better when its tokens are surprising but still high-ranked, and the ratio of average rank to average surprisal (RSR) selects such trajectories better than existing metrics.

  41. When unlearning is free: leveraging low influence points to reduce computational costs

    cs.LG 2025-12 conditional novelty 5.0

    Low-influence training points can be dropped from forget/retain sets before unlearning, cutting runtime up to ~50% with little measured loss in accuracy or MIA-based privacy.

  42. PlanE: Meta Planning of Data, Tuning, and Inference for Extractive-based LLMs

    cs.AI 2026-05 conditional novelty 4.0

    A quadratic meta-planner trained on a few model-dataset runs selects the optimal data-tuning-inference configuration for extractive LLMs, matching grid search on three IE tasks.

  43. Mechanistic Anomaly Detection via Functional Attribution

    cs.LG 2026-04 conditional novelty 4.0

    A grid-free attention-based deep learning model interpolates surface-level PM2.5 concentrations across the US using sparse sensor data and auxiliary geospatial features.

  44. In-Run Data Shapley for Adam Optimizer

    cs.LG 2026-01 reject novelty 4.0

    An 'Adam-aware' approximation for In-Run Data Shapley is proposed, but its central theorem is not proven and the fidelity test uses a proxy that is not the true Shapley value.

  45. What Is The Performance Ceiling of My Classifier? Utilizing Category-Wise Influence Functions for Pareto Frontier Analysis

    cs.LG 2025-10 conditional novelty 4.0

    Category-wise influence vectors plus linear programming and a genetic algorithm reweight training data to improve all classes at once, with an unproven criterion for when a classifier has reached its Pareto ceiling.