Using both URLs and screenshots with API-based multimodal LLMs reaches 93-94% accuracy on a 1,000-site phishing test set, and a URL-first agentic cascade cuts API costs 2.6-4.2x with only minor accuracy loss.
PhishLang: A Real-Time, Fully Client-Side Phishing Detection Framework Using MobileBERT
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
In this paper, we introduce PhishLang, the first fully client-side anti-phishing framework built on a lightweight ensemble framework that utilizes advanced language models to analyze the contextual features of a website's source code and URL. Unlike traditional heuristic or machine learning approaches that rely on static features and struggle to adapt to evolving threats, or deep learning models that are computationally intensive, our approach utilizes MobileBERT, a fast and memory-efficient variant of the BERT architecture, to capture nuanced features indicative of phishing attacks. To further enhance detection accuracy, PhishLang employs a multi-modal ensemble approach, combining both the URL and Source detection models. This architecture ensures robustness by allowing one model to compensate for scenarios where the other may fail, or if both models provide ambiguous inferences. As a result, PhishLang excels at detecting both regular and evasive phishing threats, including zero-day attacks, outperforming popular anti-phishing tools, while operating without relying on external blocklists and safeguarding user privacy by ensuring that browser history remains entirely local and unshared. We release PhishLang as a Chromium browser extension and also open-source the framework to aid the research community.
citation-role summary
citation-polarity summary
fields
cs.AI 1years
2024 1verdicts
CONDITIONAL 1roles
baseline 1polarities
baseline 1representative citing papers
citing papers explorer
-
Large Multimodal Agents for Accurate Phishing Detection with Enhanced Token Optimization and Cost Reduction
Using both URLs and screenshots with API-based multimodal LLMs reaches 93-94% accuracy on a 1,000-site phishing test set, and a URL-first agentic cascade cuts API costs 2.6-4.2x with only minor accuracy loss.