Pith. sign in

REVIEW 1 cited by

SemEval-2025 Task 4: Unlearning sensitive content from Large Language Models

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2504.02883 v1 pith:HD7LYUUT submitted 2025-04-02 cs.CL cs.LG

classification cs.CLcs.LG
keywords taskunlearnunlearningcontentdifferentdocumentsformlanguage
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

We introduce SemEval-2025 Task 4: unlearning sensitive content from Large Language Models (LLMs). The task features 3 subtasks for LLM unlearning spanning different use cases: (1) unlearn long form synthetic creative documents spanning different genres; (2) unlearn short form synthetic biographies containing personally identifiable information (PII), including fake names, phone number, SSN, email and home addresses, and (3) unlearn real documents sampled from the target model's training dataset. We received over 100 submissions from over 30 institutions and we summarize the key techniques and lessons in this paper.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. iShumei-Chinchunmei at SemEval-2025 Task 4: A balanced forgetting and retention multi-task framework using effective unlearning loss

    cs.CL 2025-07 conditional novelty 3.0 of 10

    The authors propose Effective Unlearning Loss, the inverse of the standard next-token prediction loss, within a multi-task framework, and report a 5th-place finish at SemEval-2025 Task 4.

Pith tools