LLM agents reach only 35% average checkpoint completion on ten realistic CTF challenges in a new open benchmark with automated partial-credit scoring.
Title resolution pending
3 Pith papers cite this work. Polarity classification is still indexing.
3
Pith papers citing it
years
2026 3verdicts
UNVERDICTED 3representative citing papers
ContraFix uses contrastive runtime analysis plus a dual-track skill base to reach 92% resolution on SEC-Bench and 73.8% on PatchEval while improving semantic correctness of patches.
AgentStop uses execution signals to early-terminate failing local LLM agent trajectories, cutting energy use 15-20% with minimal utility loss.
citing papers explorer
-
Do Agents Dream of Root Shells? Partial-Credit Evaluation of LLM Agents in Capture the Flag Challenges
LLM agents reach only 35% average checkpoint completion on ten realistic CTF challenges in a new open benchmark with automated partial-credit scoring.
-
ContraFix: Skill-Enhanced Contrastive Runtime Analysis for Vulnerability Repair
ContraFix uses contrastive runtime analysis plus a dual-track skill base to reach 92% resolution on SEC-Bench and 73.8% on PatchEval while improving semantic correctness of patches.
-
AgentStop: Terminating Local AI Agents Early to Save Energy in Consumer Devices
AgentStop uses execution signals to early-terminate failing local LLM agent trajectories, cutting energy use 15-20% with minimal utility loss.