pith:S2TJTMPP
Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection
Self-RAG trains a single language model to adaptively retrieve passages on demand and critique its own outputs using special reflection tokens.
arxiv:2310.11511 v1 · 2023-10-17 · cs.CL · cs.AI · cs.LG
Add to your LaTeX paper
\usepackage{pith}
\pithnumber{S2TJTMPPYHW32D5ESW4VJ672LC}
Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge
Record completeness
Claims
Self-RAG (7B and 13B parameters) significantly outperforms state-of-the-art LLMs and retrieval-augmented models on a diverse set of tasks. Specifically, Self-RAG outperforms ChatGPT and retrieval-augmented Llama2-chat on Open-domain QA, reasoning and fact verification tasks, and it shows significant gains in improving factuality and citation accuracy for long-form generations relative to these models.
That an arbitrary LM can be trained to generate and act on reflection tokens in a way that improves rather than degrades performance across tasks without introducing new failure modes from the added tokens.
Self-RAG trains LLMs to adaptively retrieve passages on demand and self-critique using reflection tokens, outperforming ChatGPT and retrieval-augmented Llama2 on QA, reasoning, and fact verification.
References
Formal links
Cited by
Receipt and verification
| First computed | 2026-07-05T07:02:08.374924Z |
|---|---|
| Builder | pith-number-builder-2026-05-17-v1 |
| Signature | Pith Ed25519
(pith-v1-2026-05) · public key |
| Schema | pith-number/v1.0 |
Canonical hash
96a699b1efc1edbd0fa495b954fbfa58bc4baefed86c2e351038dcb7ef6897de
Aliases
· · · · ·Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/S2TJTMPPYHW32D5ESW4VJ672LC \
| jq -c '.canonical_record' \
| python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 96a699b1efc1edbd0fa495b954fbfa58bc4baefed86c2e351038dcb7ef6897de
Canonical record JSON
{
"metadata": {
"abstract_canon_sha256": "561e44b2432b4f4e957118a069dde7fae8fc9bfbf8aac408de3d4dfd1beed17d",
"cross_cats_sorted": [
"cs.AI",
"cs.LG"
],
"license": "http://creativecommons.org/licenses/by/4.0/",
"primary_cat": "cs.CL",
"submitted_at": "2023-10-17T18:18:32Z",
"title_canon_sha256": "4a2dd2ad87d2a6160674ba66eff6276562daa1a531df578df1f5f1e675a0628c"
},
"schema_version": "1.0",
"source": {
"id": "2310.11511",
"kind": "arxiv",
"version": 1
}
}