Pith Number

pith:OVCYLFVB

pith:2026:OVCYLFVBDJXXZCZZN4EYQ2IDXB

not attested not anchored not stored refs pending

SecGoal: A Benchmark for Extracting Formalizable Security Goals from Protocol Documents

Bo Jia, Dawei Huang, Haonan Feng, Hui Li, Jingjing Guan, Xiangdong Li, Yueshuang Jiao

Instruction tuning on SecGoal lets 7B and 9B models extract security goals from protocol documents at over 80% F1 while larger general models fall below 15% precision.

arxiv:2604.27601 v2 · 2026-04-30 · cs.CR

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{OVCYLFVBDJXXZCZZN4EYQ2IDXB}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Claims

C1strongest claim

instruction tuning on SecGoal enables compact models with 7B/9B parameters to achieve F1-scores above 80%, substantially outperforming larger general-purpose models.

C2weakest assumption

The expert-annotated security goals in the SecGoal benchmark are accurate, unbiased, and sufficient to train models that generalize to new protocol documents.

C3one line summary

The paper presents SecGoal, the first expert-annotated benchmark for security goal extraction from protocol documents, and demonstrates that fine-tuned 7B/9B parameter models achieve over 80% F1 score, outperforming larger general LLMs.

Receipt and verification

First computed	2026-05-29T01:05:10.997628Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

75458596a11a6f7c8b396f09886903b86da998f1b4e7545caf9c72f3bd77ae87

Aliases

arxiv: 2604.27601 · arxiv_version: 2604.27601v2 · doi: 10.48550/arxiv.2604.27601 · pith_short_12: OVCYLFVBDJXX · pith_short_16: OVCYLFVBDJXXZCZZ · pith_short_8: OVCYLFVB

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/OVCYLFVBDJXXZCZZN4EYQ2IDXB \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 75458596a11a6f7c8b396f09886903b86da998f1b4e7545caf9c72f3bd77ae87

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "edb7636e7880f74ba2e2f88704e72a3fe328195399bac0b9163e945f74d19799",
    "cross_cats_sorted": [],
    "license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
    "primary_cat": "cs.CR",
    "submitted_at": "2026-04-30T08:50:03Z",
    "title_canon_sha256": "19fd408c5b174f7abe71432440bdb5ed2972bd9b814f2c16f2f57ac9923dfa10"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2604.27601",
    "kind": "arxiv",
    "version": 2
  }
}