Pith. sign in

REVIEW 3 cited by

Neuron-Level Differentiation of Memorization and Generalization in Large Language Models

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2412.18497 v2 pith:73G2B76H submitted 2024-12-24 cs.CL

classification cs.CL
keywords generalizationmemorizationmodelbehaviorlanguagelargellmsmodels
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

We investigate how Large Language Models (LLMs) distinguish between memorization and generalization at the neuron level. Through carefully designed tasks, we identify distinct neuron subsets responsible for each behavior. Experiments on both a GPT-2 model trained from scratch and a pretrained LLaMA-3.2 model fine-tuned with LoRA show consistent neuron-level specialization. We further demonstrate that inference-time interventions on these neurons can steer the model's behavior toward memorization or generalization. To assess robustness, we evaluate intra-task and inter-task consistency, confirming that these neuron-behavior associations reflect generalizable patterns rather than dataset-specific artifacts. Our findings reveal modular structure in LLMs and enable controlling memorization and generalization behaviors at inference time.

Discussion (0). Sign in to comment.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Rethinking Memorization Measures and their Implications in Large Language Models

    cs.LG 2025-07 conditional novelty 6.0 of 10

    Contextual memorization, defined by comparing a string's training loss against the best loss without training on that string, is stricter than counterfactual memorization and suggests that zero-memorization optimal le...

  2. Answer-Centric or Reasoning-Driven? Uncovering the Latent Memory Anchor in LLMs

    cs.CL 2025-06 conditional novelty 5.0 of 10

    Across ten LLMs, masking the final answer inside a complete reasoning chain causes a 26.9-point accuracy drop, evidence that models anchor to answers, not reasoning templates.

  3. Beyond Frequency: The Role of Redundancy in Large Language Model Memorization

    cs.LG 2025-06 reject novelty 4.0 of 10

    LLM memorization is concentrated in low-redundancy (high-entropy) samples, which are roughly twice as fragile under prefix perturbation as high-redundancy samples, according to the paper's measurements on Pythia models.

Pith tools