REVIEW 8 cited by
A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Ugly
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Large Language Models (LLMs), such as ChatGPT and Bard, have revolutionized natural language understanding and generation. They possess deep language comprehension, human-like text generation capabilities, contextual awareness, and robust problem-solving skills, making them invaluable in various domains (e.g., search engines, customer support, translation). In the meantime, LLMs have also gained traction in the security community, revealing security vulnerabilities and showcasing their potential in security-related tasks. This paper explores the intersection of LLMs with security and privacy. Specifically, we investigate how LLMs positively impact security and privacy, potential risks and threats associated with their use, and inherent vulnerabilities within LLMs. Through a comprehensive literature review, the paper categorizes the papers into "The Good" (beneficial LLM applications), "The Bad" (offensive applications), and "The Ugly" (vulnerabilities of LLMs and their defenses). We have some interesting findings. For example, LLMs have proven to enhance code security (code vulnerability detection) and data privacy (data confidentiality protection), outperforming traditional methods. However, they can also be harnessed for various attacks (particularly user-level attacks) due to their human-like reasoning abilities. We have identified areas that require further research efforts. For example, Research on model and parameter extraction attacks is limited and often theoretical, hindered by LLM parameter scale and confidentiality. Safe instruction tuning, a recent development, requires more exploration. We hope that our work can shed light on the LLMs' potential to both bolster and jeopardize cybersecurity.
Forward citations
Cited by 8 Pith papers
-
CelloAI: Leveraging Large Language Models for HPC Software Development in High Energy Physics
A locally hosted RAG-based coding assistant improves kernel retrieval and porting coverage for HEP codebases, though no tested LLM correctly ports the hardest kernels.
-
Automated Privacy Information Annotation in Large Language Model Interactions
A 249K-query English/Chinese dataset with 154K privacy phrases and a benchmark showing fine-tuned 1B-7B local models can detect privacy leaks, with 87.6% leakage accuracy but only 44.7% information-level F1.
-
DETAM: Defending LLMs Against Jailbreak Attacks via Targeted Attention Modification
Targeted attention-head modification, tuned on jailbreak data, lowers attack success rates across models and attacks without fine-tuning.
-
Model Inversion in Split Learning for Personalized LLMs: New Insights from Information Bottleneck Theory
RevertLM reconstructs private text from intermediate LLM representations in split learning using a projection into embedding space plus a generative decoder, outperforming prior embedding-only attacks.
-
Operational Evidence Gaps for LLMs in Fraud Detection and Trust-and-Safety Workflows
A survey of 49 LLM fraud and trust-and-safety papers finds that fraud work reports almost no per-decision latency, cost, or calibration evidence, while moderation work reports more.
-
Multilingual and Explainable Text Detoxification with Parallel Corpora
New parallel text detoxification corpora for five languages, a GPT-4-based cross-lingual analysis of toxicity features, and a cluster-conditioned chain-of-thought prompting method that yields a marginal average gain.
-
A Survey of Foundation Model-Powered Recommender Systems: From Feature-Based, Generative to Agentic Paradigms
A survey that organizes foundation-model recommender systems into feature-based, generative, and agentic paradigms and reviews tasks, empirical results, and open challenges.
-
A Survey on Responsible LLMs: Inherent Risk, Malicious Use, and Mitigation Strategy
A survey that organizes responsible-LLM research into five risk dimensions and four intervention phases, reviewing privacy, hallucination, value, toxicity, and jailbreak mitigation.
Discussion (0). Continue with ORCID to comment.