Pith. sign in

REVIEW 2 cited by

Badllama 3: removing safety finetuning from Llama 3 in minutes

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2407.01376 v1 pith:OP3IYXKF submitted 2024-07-01 cs.LG cs.AIcs.CLcs.CR

classification cs.LGcs.AIcs.CLcs.CR
keywords fine-tuningllamasafetyminutesaccessadvancesalgorithmicattacker
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

We show that extensive LLM safety fine-tuning is easily subverted when an attacker has access to model weights. We evaluate three state-of-the-art fine-tuning methods-QLoRA, ReFT, and Ortho-and show how algorithmic advances enable constant jailbreaking performance with cuts in FLOPs and optimisation power. We strip safety fine-tuning from Llama 3 8B in one minute and Llama 3 70B in 30 minutes on a single GPU, and sketch ways to reduce this further.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. SoK: Systematizing LLM Prompt Security: Taxonomies, Datasets, and Unified Evaluation of Attacks and Defenses

    cs.CR 2025-10 conditional novelty 6.0 of 10

    A systemization of LLM jailbreak security that adds linked taxonomies, an evaluation platform, and JailbreakDB, while its main attack–defense comparison results remain deferred.

  2. Mitigating Cyber Risk in the Age of Open-Weight LLMs: Policy Gaps and Technical Realities

    cs.CR 2025-05 unverdicted novelty 2.0 of 10

    A policy analysis arguing that open-weight LLMs' loss-of-control properties make many cyber mitigations and the EU AI Act inadequate, and that capability-specific, downstream-focused regulation is the pragmatic alternative.

Pith tools