pith:LZJMXACJ
Guardrails Beat Guidance: A Large-Scale Study of Rules, Skills, and Persistent Configuration for Coding Agents
Negative constraints raise AI coding agent success rates while positive instructions lower them, and random rules match expert ones.
arxiv:2604.11088 v2 · 2026-04-13 · cs.AI · cs.CL
Add to your LaTeX paper
\usepackage{pith}
\pithnumber{LZJMXACJ2QOP7HZXTFKINNIWCF}
Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge
Record completeness
Claims
Rules improve performance by 7--14 percentage points, but random rules help as much as expert-curated ones -- suggesting rules work through context priming rather than specific instruction. Negative constraints are the only individually beneficial rule type, while positive directives actively hurt.
That differences in agent success rates are caused by the rule types themselves rather than unmeasured factors in how rules are inserted into prompts or variations across agent runs.
Negative constraints in agent rules improve coding performance via context priming while positive directives degrade it, with collective rules remaining helpful up to 50 rules.
Cited by
Receipt and verification
| First computed | 2026-05-29T01:05:09.360267Z |
|---|---|
| Builder | pith-number-builder-2026-05-17-v1 |
| Signature | Pith Ed25519
(pith-v1-2026-05) · public key |
| Schema | pith-number/v1.0 |
Canonical hash
5e52cb8049d41cff9f37995486b516115c78fdf867d1b9c76f5964c7ca721b64
Aliases
· · · · ·Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/LZJMXACJ2QOP7HZXTFKINNIWCF \
| jq -c '.canonical_record' \
| python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 5e52cb8049d41cff9f37995486b516115c78fdf867d1b9c76f5964c7ca721b64
Canonical record JSON
{
"metadata": {
"abstract_canon_sha256": "9ddbe9ead40d1e75fbf7d5c1bd1d2688dc8c2b4a350c36f98988ecc1294a6228",
"cross_cats_sorted": [
"cs.CL"
],
"license": "http://creativecommons.org/licenses/by-nc-sa/4.0/",
"primary_cat": "cs.AI",
"submitted_at": "2026-04-13T07:10:01Z",
"title_canon_sha256": "9e767301e3cdcde0e6a2b375adcccddcc3020265586dd650c38257304c39e7ca"
},
"schema_version": "1.0",
"source": {
"id": "2604.11088",
"kind": "arxiv",
"version": 2
}
}