Pith. sign in

REVIEW 15 cited by

SentinelAgent: Graph-based Anomaly Detection in Multi-Agent Systems

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2505.24201 v1 pith:5HTNLYAV submitted 2025-05-30 cs.AI

SentinelAgent: Graph-based Anomaly Detection in Multi-Agent Systems

classification cs.AI
keywords detectionagentanomalyframeworkmulti-agentsystemsexecutiongraph-based
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
Share X Bluesky LinkedIn Reddit HN
read the original abstract

The rise of large language model (LLM)-based multi-agent systems (MAS) introduces new security and reliability challenges. While these systems show great promise in decomposing and coordinating complex tasks, they also face multi-faceted risks across prompt manipulation, unsafe tool usage, and emergent agent miscoordination. Existing guardrail mechanisms offer only partial protection, primarily at the input-output level, and fall short in addressing systemic or multi-point failures in MAS. In this work, we present a system-level anomaly detection framework tailored for MAS, integrating structural modeling with runtime behavioral oversight. Our approach consists of two components. First, we propose a graph-based framework that models agent interactions as dynamic execution graphs, enabling semantic anomaly detection at node, edge, and path levels. Second, we introduce a pluggable SentinelAgent, an LLM-powered oversight agent that observes, analyzes, and intervenes in MAS execution based on security policies and contextual reasoning. By bridging abstract detection logic with actionable enforcement, our method detects not only single-point faults and prompt injections but also multi-agent collusion and latent exploit paths. We validate our framework through two case studies, including an email assistant and Microsoft's Magentic-One system, demonstrating its ability to detect covert risks and provide explainable root-cause attribution. Our work lays the foundation for more trustworthy, monitorable, and secure agent-based AI ecosystems.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 15 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Moltbook Moderation: Uncovering Hidden Intent Through Multi-Turn Dialogue

    cs.AI 2026-05 unverdicted novelty 7.0

    Bot-Mod uses multi-turn dialogue guided by Gibbs sampling over intent hypotheses to identify malicious agent behavior in communities, showing reliable detection with low false positives on a Moltbook-derived dataset.

  2. Detecting Multi-Agent Collusion Through Multi-Agent Interpretability

    cs.AI 2026-04 conditional novelty 7.0

    NARCBench and five activation-probing methods detect multi-agent collusion with 0.73-1.00 AUROC across distribution shifts and steganographic tasks by aggregating per-agent signals.

  3. AgentBound: Securing Execution Boundaries of AI Agents

    cs.CR 2025-10 conditional novelty 7.0

    AgentBound is the first declarative access control framework for Model Context Protocol servers that generates policies from source code at 80.9% accuracy and blocks most threats in malicious servers with negligible overhead.

  4. MESA: Prioritizing Vulnerable Communication Channels for Securing Multi-Agent Systems

    cs.CR 2026-06 unverdicted novelty 6.0

    MESA ranks MAS communication edges by vulnerability via graph-theoretic metrics and dynamic probes, achieving mean Spearman ρ=+0.60 correlation with empirical per-edge attack success and 3x interception gain when moni...

  5. When Planning Fails Despite Correct Execution: On Epistemic Calibration for LLM-Based Multi-Agent Systems

    cs.AI 2026-05 unverdicted novelty 6.0

    Introduces EPC-AW to mitigate epistemic miscalibration in LLM multi-agent planning via consistency-based selection and refinement, reporting 9.75% average success improvement.

  6. Moltbook Moderation: Uncovering Hidden Intent Through Multi-Turn Dialogue

    cs.AI 2026-05 unverdicted novelty 6.0

    BOT-MOD uncovers hidden agent intent in multi-agent environments like Moltbook through guided multi-turn dialogue and Gibbs-based sampling over intent hypotheses.

  7. Content-Aware Attack Detection in LLM Agent Tool-Call Traffic: An Empirical Study of Features, Architectures, and Evaluation Protocols

    cs.CR 2026-05 unverdicted novelty 6.0

    MCPShield models MCP tool-call sessions as graphs with SBERT embeddings and shows that content features raise AUROC above 0.89 while tree ensembles on pooled embeddings reach 0.975, outperforming GNNs and exposing inf...

  8. Content-Aware Attack Detection in LLM Agent Tool-Call Traffic: An Empirical Study of Features, Architectures, and Evaluation Protocols

    cs.CR 2026-05 conditional novelty 6.0

    MCPShield detects attacks on LLM agent tool-call traffic by encoding sessions as graphs enriched with SBERT content embeddings, achieving AUROC above 0.89 with content features versus 0.64 for metadata alone.

  9. From Spark to Fire: Modeling and Mitigating Error Cascades in LLM-Based Multi-Agent Collaboration

    cs.MA 2026-03 unverdicted novelty 6.0

    A graph-based propagation model for error cascades in LLM multi-agent systems plus a genealogy-graph governance plugin that prevents final infection in at least 89% of runs across tested frameworks.

  10. Runtime Uncertainty Monitoring for LLM-Based Multi-Agent Systems Using Bayesian Networks

    cs.AI 2026-07 conditional novelty 5.0

    A Bayesian-network monitor built on calibrated LLM log-probabilities gives workflow-level uncertainty scores for an actuarial multi-agent system, reproducing baseline RMSE but not clearly separating normal from pertur...

  11. GRADE: Graph Representation of LLM Agent Dependency and Execution

    cs.LG 2026-06 unverdicted novelty 5.0

    GRADE models any LLM agent run as a graph with execution and graded dependency edge layers to enable failure prediction and fault localization across tool, coding, and web agent corpora.

  12. Content-Aware Attack Detection in LLM Agent Tool-Call Traffic: An Empirical Study of Features, Architectures, and Evaluation Protocols

    cs.CR 2026-05 unverdicted novelty 5.0

    Content embeddings from SBERT enable AUROC above 0.89 for attack detection in MCP tool-call sessions, with tree ensembles on pooled embeddings reaching 0.975 and outperforming GNNs when using task-stratified splits in...

  13. Secure Multi-LLM Agentic AI and Agentification for Edge General Intelligence by Zero-Trust: A Survey

    cs.NI 2025-08 conditional novelty 4.0

    A survey proposing zero-trust architecture for multi-LLM systems in edge computing, with a taxonomy of model- and system-level defenses and a conceptual framework.

  14. Agent System Operations: Categorization, Challenges, and Future Directions

    cs.MA 2026-06 unverdicted novelty 3.0

    This survey categorizes anomalies in agent systems into intra-agent and inter-agent types and introduces the AgentOps framework with four operational stages.

  15. Challenges and Future Directions in Agentic Reverse Engineering Systems

    cs.CR 2026-04 unverdicted novelty 3.0

    Agentic LLM systems for reverse engineering fail on obfuscation, timing, and unique architectures due to token limits and missing guardrails, with challenges and directions proposed.