Paper Citation Record · LEDGER

Towards Evaluation for Real-World LLM Unlearning

As of 9 August 2026, this Paper Citation Record lists 46 of 46 outbound references and 0 inbound Pith citation observations for arXiv:2508.01324.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2508.01324 v1

Coverage vector

measured 46 of 46 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T05:48:02.907156Z

measured 46 of 46 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

46 of 46 outbound references displayed

verified exact1
verified fuzzy14
unresolved31
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 5db9453e-bb15-42e4-888c-32fcae6c3ed6 · outbound

This paper cites Sulla determinazione empirica di una legge didistribuzione.

Towards Evaluation for Real-World LLM Unlearning Sulla determinazione empirica di una legge didistribuzione

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T05:48:03.697474Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation d979d22c-1367-4d60-963a-c3c9a6325924 · outbound

This paper cites Machine unlearning.

Towards Evaluation for Real-World LLM Unlearning Machine unlearning

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.529864Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b4656c86-009d-4319-af1b-fa78faa77834 · outbound

This paper cites Extracting training data from large language models.

Towards Evaluation for Real-World LLM Unlearning Extracting training data from large language models

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.534875Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d8baadf5-d4a0-44f1-8adc-2e4bd587d0f0 · outbound

This paper cites Unlearn What You Want to Forget: Efficient Unlearning for LLMs.

Towards Evaluation for Real-World LLM Unlearning Unlearn What You Want to Forget: Efficient Unlearning for LLMs

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.539689Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7e6c7a0d-a9dc-455d-b2b3-ad61c5568607 · outbound

This paper cites Simplicity prevails: Rethinking negative preference optimization for llm unlearning, 2024.

Towards Evaluation for Real-World LLM Unlearning Simplicity prevails: Rethinking negative preference optimization for llm unlearning, 2024

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.544965Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a5bd44a8-2f20-4a47-80a5-fa635c0e9631 · outbound

This paper cites LawBench: Benchmarking Legal Knowledge of Large Language Models.

Towards Evaluation for Real-World LLM Unlearning LawBench: Benchmarking Legal Knowledge of Large Language Models

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.549792Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 414fd268-5811-4931-9a20-c655fd4f282f · outbound

This paper cites Ticketed learning–unlearning schemes.

Towards Evaluation for Real-World LLM Unlearning Ticketed learning–unlearning schemes

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T05:48:03.663147Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 4dace75a-b854-4480-ad13-d80aaf9291e1 · outbound

This paper cites Making ai forget you: Data deletion in machine learning.

Towards Evaluation for Real-World LLM Unlearning Making ai forget you: Data deletion in machine learning

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.559890Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f1ca4b13-82fd-45de-8ff3-f4c5a1143e78 · outbound

This paper cites Adaptive machine unlearning.

Towards Evaluation for Real-World LLM Unlearning Adaptive machine unlearning

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T05:48:03.637383Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation f5f5ad93-e668-43b0-851b-f4cb62943f08 · outbound

This paper cites Fantastic Copyrighted Beasts and How (Not) to Generate Them.

Towards Evaluation for Real-World LLM Unlearning Fantastic Copyrighted Beasts and How (Not) to Generate Them

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.569006Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 931bf2cb-d779-4145-b4f9-d0b09616ac81 · outbound

This paper cites Foundation Models and Fair Use.

Towards Evaluation for Real-World LLM Unlearning Foundation Models and Fair Use

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.573991Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 953de8b7-c633-420b-adbb-3e320365b80a · outbound

This paper cites Unlearning or Obfuscating? Jogging the Memory of Unlearned LLMs via Benign Relearning.

Towards Evaluation for Real-World LLM Unlearning Unlearning or Obfuscating? Jogging the Memory of Unlearned LLMs via Benign Relearning

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.579035Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c7211c40-63de-445f-997a-d3c405bfb183 · outbound

This paper cites Eraser: Machine unlearning in mlaas via an inference serving-aware approach.

Towards Evaluation for Real-World LLM Unlearning Eraser: Machine unlearning in mlaas via an inference serving-aware approach

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.583899Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7c87c9ab-950b-4559-87fd-970441babda6 · outbound

This paper cites Editing models with task arithmetic, 2023.

Towards Evaluation for Real-World LLM Unlearning Editing models with task arithmetic, 2023

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.588391Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation adfa6778-831f-46e8-9ac3-cd8d7a9abc48 · outbound

This paper cites Knowledge sanitization of large language models,.

Towards Evaluation for Real-World LLM Unlearning Knowledge sanitization of large language models,

Reference 15

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T05:48:03.602515Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation e7518439-8fb7-4301-bc7a-1f1b8a9c1394 · outbound

This paper cites Approximate data deletion from machine learning models.

Towards Evaluation for Real-World LLM Unlearning Approximate data deletion from machine learning models

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.602641Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 516c5bd1-6858-49d0-82e0-5c232f8ae232 · outbound

This paper cites Knowledge Unlearning for Mitigating Privacy Risks in Language Models.

Towards Evaluation for Real-World LLM Unlearning Knowledge Unlearning for Mitigating Privacy Risks in Language Models

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.607226Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f5c278cd-5460-4480-a3e7-98ac5ede2096 · outbound

This paper cites RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models.

Towards Evaluation for Real-World LLM Unlearning RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.612369Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b011107c-7be2-4410-832f-4bba8d4975f7 · outbound

This paper cites Privacy Adhering Machine Un-learning in NLP.

Towards Evaluation for Real-World LLM Unlearning Privacy Adhering Machine Un-learning in NLP

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.616811Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 154f0426-2040-48d8-817e-9ec239c4edce · outbound

This paper cites The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearning.

Towards Evaluation for Real-World LLM Unlearning The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearning

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.621729Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 334db7be-be5e-4d91-b5ab-aeb8fd449c57 · outbound

This paper cites Large language models in finance: A survey.

Towards Evaluation for Real-World LLM Unlearning Large language models in finance: A survey

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T05:48:03.578378Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation db6db72e-136e-461e-aabd-d023f4bef501 · outbound

This paper cites Continual learning and private unlearning, 2022.

Towards Evaluation for Real-World LLM Unlearning Continual learning and private unlearning, 2022

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T05:48:03.563558Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 78c20564-86f0-4dc2-97aa-71b59ff41221 · outbound

This paper cites Federated Unlearning.

Towards Evaluation for Real-World LLM Unlearning Federated Unlearning

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.639487Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 64b8329b-87ff-41b4-8308-57b5c10de8a1 · outbound

This paper cites Quark: Controllable text generation with reinforced unlearning.

Towards Evaluation for Real-World LLM Unlearning Quark: Controllable text generation with reinforced unlearning

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.661057Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 20d47fb7-7c61-430c-9989-063b3b707d9c · outbound

This paper cites Eight methods to evaluate robust unlearning in llms, 2024.

Towards Evaluation for Real-World LLM Unlearning Eight methods to evaluate robust unlearning in llms, 2024

Reference 25

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T05:48:03.539146Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation a9ac0ed7-b71a-4457-a1d9-95ff66c7ab1d · outbound

This paper cites TOFU: A Task of Fictitious Unlearning for LLMs.

Towards Evaluation for Real-World LLM Unlearning TOFU: A Task of Fictitious Unlearning for LLMs

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.713221Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 12359976-7c7d-4582-8e59-a0f3f0a85231 · outbound

This paper cites SILO Language Models: Isolating Legal Risk In a Nonparametric Datastore.

Towards Evaluation for Real-World LLM Unlearning SILO Language Models: Isolating Legal Risk In a Nonparametric Datastore

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.729818Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 683d92f7-89a7-46e7-9dc5-df3e00a8b553 · outbound

This paper cites Can Sensitive Information Be Deleted From LLMs? Objectives for Defending Against Extraction Attacks.

Towards Evaluation for Real-World LLM Unlearning Can Sensitive Information Be Deleted From LLMs? Objectives for Defending Against Extraction Attacks

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.749611Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1d9e1ad5-fc32-4ee7-a184-567033d4fd30 · outbound

This paper cites In-Context Unlearning: Language Models as Few Shot Unlearners.

Towards Evaluation for Real-World LLM Unlearning In-Context Unlearning: Language Models as Few Shot Unlearners

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.768760Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7ea821e2-976d-4202-903b-75b98fd3a9f6 · outbound

This paper cites Manning, and Chelsea Finn.

Towards Evaluation for Real-World LLM Unlearning Manning, and Chelsea Finn

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.786038Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e5aa771c-3f4d-44ce-95b9-c360057529ea · outbound

This paper cites Remember what you want to forget: Algorithms for machine unlearning.

Towards Evaluation for Real-World LLM Unlearning Remember what you want to forget: Algorithms for machine unlearning

Reference 31

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T05:48:03.515596Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 5eb0a70d-e603-4544-9080-e74b651b3c44 · outbound

This paper cites MUSE: Machine Unlearning Six-Way Evaluation for Language Models.

Towards Evaluation for Real-World LLM Unlearning MUSE: Machine Unlearning Six-Way Evaluation for Language Models

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.822371Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b438490b-c157-4b40-9d56-be645ccbc383 · outbound

This paper cites an unresolved cited work.

Towards Evaluation for Real-World LLM Unlearning Unresolved cited work

Reference 33

Resolution: unresolved; raw_fallback, observed 2026-08-06T05:48:03.500982Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation f8484393-34d5-4b2a-8ea5-aac4c3780606 · outbound

This paper cites Chatgpt: Optimizing language models for dialogue.

Towards Evaluation for Real-World LLM Unlearning Chatgpt: Optimizing language models for dialogue

Reference 34

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T05:48:03.486923Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 1d2fe6b2-be13-4a70-9a38-7217bb885fbe · outbound

This paper cites Guardrail baselines for unlearning in llms, 2024.

Towards Evaluation for Real-World LLM Unlearning Guardrail baselines for unlearning in llms, 2024

Reference 35

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T05:48:03.472838Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 7eb13d51-1919-46a2-8ba7-bc4a219f6252 · outbound

This paper cites Large language models in medicine.Nature medicine, 29(8):1930–1940, 2023.

Towards Evaluation for Real-World LLM Unlearning Large language models in medicine.Nature medicine, 29(8):1930–1940, 2023

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.870689Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 832cc68c-96d2-4ca5-ae96-c5efd9f0ac13 · outbound

This paper cites Towards efficient and effective unlearning of large language models for recommendation,.

Towards Evaluation for Real-World LLM Unlearning Towards efficient and effective unlearning of large language models for recommendation,

Reference 37

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T05:48:03.449164Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation bc137143-2c23-456c-9ae8-5d7827c67742 · outbound

This paper cites DEPN: Detecting and Editing Privacy Neurons in Pretrained Language Models.

Towards Evaluation for Real-World LLM Unlearning DEPN: Detecting and Editing Privacy Neurons in Pretrained Language Models

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.882817Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 14fcf720-556e-41d5-9827-a5a6e793be66 · outbound

This paper cites Towards Efficient and Effective Unlearning of Large Language Models for Recommendation.

Towards Evaluation for Real-World LLM Unlearning Towards Efficient and Effective Unlearning of Large Language Models for Recommendation

Reference 39

Resolution: verified exact; local_arxiv, observed 2026-08-06T05:48:02.997663Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 5d398bde-1759-462c-b430-fde0b50e9f83 · outbound

This paper cites Evaluating reading comprehension exercises generated by llms: A showcase of chatgpt in education applications.

Towards Evaluation for Real-World LLM Unlearning Evaluating reading comprehension exercises generated by llms: A showcase of chatgpt in education applications

Reference 40

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T05:48:03.420844Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 7ec5b1e5-a801-4576-952a-c1f8445102b6 · outbound

This paper cites Deltagrad: Rapid retraining of machine learning models.

Towards Evaluation for Real-World LLM Unlearning Deltagrad: Rapid retraining of machine learning models

Reference 41

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T05:48:03.434863Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation eeb4f3fd-fc45-4d08-be27-f8662f67065e · outbound

This paper cites Composing Parameter-Efficient Modules with Arithmetic Operations.

Towards Evaluation for Real-World LLM Unlearning Composing Parameter-Efficient Modules with Arithmetic Operations

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.898919Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 84f1df36-2a81-4c12-be8b-b0d979384cdc · outbound

This paper cites Unlearning bias in language models by partitioning gradients.

Towards Evaluation for Real-World LLM Unlearning Unlearning bias in language models by partitioning gradients

Reference 43

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T05:48:03.406821Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 868fca0a-d5a2-4ba7-bdf7-c78b80355a92 · outbound

This paper cites Catastrophic Failure of LLM Unlearning via Quantization.

Towards Evaluation for Real-World LLM Unlearning Catastrophic Failure of LLM Unlearning via Quantization

Reference 44

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.907156Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 96d987cb-32f4-4906-8aa4-dcc6353cb777 · outbound

This paper cites Negative preference optimization: From catastrophic collapse to effective unlearning, 2024.

Towards Evaluation for Real-World LLM Unlearning Negative preference optimization: From catastrophic collapse to effective unlearning, 2024

Reference 45

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.903079Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e9fef472-d2b6-4f4c-b95b-8b5ce9ec8d45 · outbound

This paper cites Knowledge Sanitization of Large Language Models.

Towards Evaluation for Real-World LLM Unlearning Knowledge Sanitization of Large Language Models

Reference 2024

Resolution: unresolved; no resolver link, observed 2026-08-06T05:48:02.597724Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.