REVIEW 4 cited by
SMILES-Prompting: A Novel Approach to LLM Jailbreak Attacks in Chemical Synthesis
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
The increasing integration of large language models (LLMs) across various fields has heightened concerns about their potential to propagate dangerous information. This paper specifically explores the security vulnerabilities of LLMs within the field of chemistry, particularly their capacity to provide instructions for synthesizing hazardous substances. We evaluate the effectiveness of several prompt injection attack methods, including red-teaming, explicit prompting, and implicit prompting. Additionally, we introduce a novel attack technique named SMILES-prompting, which uses the Simplified Molecular-Input Line-Entry System (SMILES) to reference chemical substances. Our findings reveal that SMILES-prompting can effectively bypass current safety mechanisms. These findings highlight the urgent need for enhanced domain-specific safeguards in LLMs to prevent misuse and improve their potential for positive social impact.
Forward citations
Cited by 4 Pith papers
-
AntiDote: Bi-level Adversarial Training for Tamper-Resistant LLMs
A bi-level adversarial training method where a hypernetwork generates malicious LoRA patches to attack the defender, and the defender learns to nullify them, improves tamper resistance across ten open-weight LLMs with...
-
The Dual-use Dilemma in LLMs: Do Empowering Ethical Capacities Make a Degraded Utility?
A DPO-based alignment method with a balanced mixture of legal and illegal chemistry prompts improves combined safety and utility scores, but its benchmark shares training compounds and its hyperparameters are tuned on...
-
Challenges in Guardrailing Large Language Models for Science
A position paper proposing a guardrail framework with four dimensions (trustworthiness, ethics & bias, safety, legal) and implementation strategies for scientific LLM use.
-
Alignment and Safety in Large Language Models: Safety Mechanisms, Training Paradigms, and Emerging Challenges
A broad survey of LLM alignment that catalogs objectives, benchmarks, SFT/RLHF/DPO methods, and safety challenges, without contributing new experimental or theoretical results.
Discussion (0). Continue with ORCID to comment.