Token Highlighter identifies jailbreak-critical tokens using gradients of an affirmation loss and weakens them by shrinking their embeddings, lowering attack success on LLaMA-2 and Vicuna.
Many-shot jailbreaking
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
citation-role summary
baseline 1
citation-polarity summary
fields
cs.CR 1years
2024 1verdicts
CONDITIONAL 1roles
baseline 1polarities
baseline 1representative citing papers
citing papers explorer
-
Token Highlighter: Inspecting and Mitigating Jailbreak Prompts for Large Language Models
Token Highlighter identifies jailbreak-critical tokens using gradients of an affirmation loss and weakens them by shrinking their embeddings, lowering attack success on LLaMA-2 and Vicuna.