Pith. sign in

REVIEW 3 cited by

Be like a Goldfish, Don't Memorize! Mitigating Memorization in Generative LLMs

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2406.10209 v2 pith:BUZTD6GG submitted 2024-06-14 cs.CL

classification cs.CL
keywords trainingmemorizationtokensgoldfishlossmemorizemodelsbenchmarks
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Large language models can memorize and repeat their training data, causing privacy and copyright risks. To mitigate memorization, we introduce a subtle modification to the next-token training objective that we call the goldfish loss. During training, randomly sampled subsets of tokens are excluded from the loss computation. These dropped tokens are not memorized by the model, which prevents verbatim reproduction of a complete chain of tokens from the training set. We run extensive experiments training billion-scale Llama-2 models, both pre-trained and trained from scratch, and demonstrate significant reductions in extractable memorization with little to no impact on downstream benchmarks.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Crossing the Margin Cliff: Toward Relearn-Robust LLM Unlearning via Margin Calibration

    cs.AI 2026-07 conditional novelty 7.0 of 10

    Margin Calibration, a non-saturating margin-anchored LoRA polish, crosses the margin cliff and cuts post-attack relearn recovery on all 97 populated cells in the paper's stress matrix.

  2. A Closer Look on Memorization in Tabular Diffusion Model: A Data-Centric Perspective

    cs.LG 2025-05 reject novelty 6.0 of 10

    A small subset of training samples drives most memorization in tabular diffusion models, and pruning them based on early memorization signals reduces measured leakage, though the evaluation metric makes part of the ga...

  3. Democratizing AI: Open-source Scalable LLM Training on GPU-based Supercomputers

    cs.LG 2025-02 conditional novelty 6.0 of 10

    AxoNN combines 3D parallel matrix multiplication with data parallelism to reach 1.423 exaflop/s on 6,144 H100 GPUs, and reports one-pass catastrophic memorization at the 70B scale that a masked-loss technique suppresses.

Pith tools