Pith. sign in

REVIEW 8 cited by

Eraser: Jailbreaking Defense in Large Language Models via Unlearning Harmful Knowledge

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2404.05880 v2 pith:26ZTRR2F submitted 2024-04-08 cs.CL

classification cs.CL
keywords harmfulknowledgeeraserjailbreakingdefensegeneralmodelunlearning
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

Jailbreaking attacks can enable Large Language Models (LLMs) to bypass the safeguard and generate harmful content. Existing jailbreaking defense methods have failed to address the fundamental issue that harmful knowledge resides within the model, leading to potential jailbreak risks for LLMs. In this paper, we propose a novel defense method called Eraser, which mainly includes three goals: unlearning harmful knowledge, retaining general knowledge, and maintaining safety alignment. The intuition is that if an LLM forgets the specific knowledge required to answer a harmful question, it will no longer have the ability to answer harmful questions. The training of Erase does not actually require the model's own harmful knowledge, and it can benefit from unlearning general answers related to harmful queries, which means it does not need assistance from the red team. The experimental results show that Eraser can significantly reduce the jailbreaking success rate for various attacks without compromising the general capabilities of the model. Our codes are available at https://github.com/ZeroNLP/Eraser.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 8 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. SoK: Systematizing LLM Prompt Security: Taxonomies, Datasets, and Unified Evaluation of Attacks and Defenses

    cs.CR 2025-10 conditional novelty 6.0 of 10

    A systemization of LLM jailbreak security that adds linked taxonomies, an evaluation platform, and JailbreakDB, while its main attack–defense comparison results remain deferred.

  2. Unified Parameter-Efficient Unlearning for LLMs

    cs.AI 2024-11 conditional novelty 6.0 of 10

    An influence-function-based parameter editing framework performs instance removal, query modification, and response correction on PEFT adapters without retraining.

  3. SafeLLM: Unlearning Harmful Outputs from Large Language Models against Jailbreak Attacks

    cs.LG 2025-08 unverdicted novelty 5.0 of 10

    SafeLLM detects unsafe outputs, traces them to specific feedforward-network components, and applies constrained optimization to unlearn harmful generation while preserving general capability.

  4. Automating Evaluation of Diffusion Model Unlearning with (Vision-) Language Model World Knowledge

    cs.LG 2025-07 conditional novelty 5.0 of 10

    A new evaluation tool uses (vision-)language model world knowledge to rank nearby concepts and craft adversarial prompts, showing that diffusion unlearning is incomplete and that semantic similarity correlates with co...

  5. SEPS: A Separability Measure for Robust Unlearning in LLMs

    cs.CL 2025-05 conditional novelty 5.0 of 10

    SEPS measures separation of forget and retain queries in mixed prompts, and Mixed Prompt training makes unlearned LLMs much better at this separation.

  6. Generative Model Unlearning: A Survey through Target Events, Unlearning Operators, and Evaluation Protocols

    cs.LG 2025-07 conditional novelty 4.0 of 10

    A survey and framework that categorizes generative model unlearning by point-wise versus concept-wise objectives, parameter-based versus non-parametric methods, and completeness/utility/efficiency evaluation.

  7. Methods to Assess the UK Government's Current Role as a Data Provider for AI

    cs.CY 2024-11 reject novelty 4.0 of 10

    Using unlearning-based ablation and information-leakage tests, the paper finds UK government websites matter for LLM performance on welfare queries while data.gov.uk datasets are not recalled.

  8. Preventing Jailbreak Prompts as Malicious Tools for Cybercriminals: A Cyber Defense Perspective

    cs.CR 2024-11 conditional novelty 2.0 of 10

    A structured survey of jailbreak prompts and layered defenses for large language models, with six illustrative case studies and no empirical evaluation.

Pith tools