Pith Number

pith:CWLACUSR

pith:2022:CWLACUSRWUFEKM6AMMMAN3MEI5

not attested not anchored not stored refs resolved

OPT: Open Pre-trained Transformer Language Models

Anjali Sridhar, Christopher Dewan, Daniel Simig, Kurt Shuster, Luke Zettlemoyer, Mikel Artetxe, Mona Diab, Moya Chen, Myle Ott, Naman Goyal, Punit Singh Koura, Sam Shleifer, Shuohui Chen, Stephen Roller, Susan Zhang, Tianlu Wang, Todor Mihaylov, Xian Li, Xi Victoria Lin

A suite of open decoder-only transformer models up to 175B parameters matches GPT-3 performance while using only one-seventh the carbon footprint.

arxiv:2205.01068 v4 · 2022-05-02 · cs.CL · cs.LG

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{CWLACUSRWUFEKM6AMMMAN3MEI5}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Claims

C1strongest claim

We show that OPT-175B is comparable to GPT-3, while requiring only 1/7th the carbon footprint to develop.

C2weakest assumption

The benchmarks and evaluation protocols used to establish comparability between OPT-175B and GPT-3 are fair, comprehensive, and not affected by differences in training data or optimization details.

C3one line summary

OPT releases open decoder-only transformers up to 175B parameters that match GPT-3 performance at one-seventh the carbon cost, along with code and training logs.

References

294 extracted · 294 resolved · 38 Pith anchors

[1] Naman Goyal and Cynthia Gao and Vishrav Chaudhary and Peng. The. CoRR , volume =. 2021 , url =. 2106.03193 , timestamp = 2021

[2] Proceedings of the AAAI Conference on Artificial Intelligence , author= 2020 · doi:10.1609/aaai.v34i05.6399

[3] PIQA: Reasoning about physical commonsense in natural language 2020 · doi:10.1609/aaai.v34i05.6239

[4] Neural Network Ac- ceptability Judgments

[5] Biochimica et Biophysica Acta (BBA)-Protein Structure , volume= 1975

Formal links

2 machine-checked theorem links

Cited by

268 papers in Pith

Beyond Heuristic Tuning: Power-Calibrated LLM Watermarking

Akashic: A Low-Overhead LLM Inference Service with MemAttention

A Unified Detection Framework for AI-Related Content and Artifacts

Co-evolving Agent Architectures and Interpretable Reasoning for Automated Optimization

EPTS: Elastic Post-Training Sparsity for Efficient Large Language Model Compression

Receipt and verification

First computed	2026-07-05T04:33:35.682666Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

1596015251b50a4533c0631806ed8447695f4402afde97f760aa83815f3887d3

Aliases

arxiv: 2205.01068 · arxiv_version: 2205.01068v4 · doi: 10.48550/arxiv.2205.01068 · pith_short_12: CWLACUSRWUFE · pith_short_16: CWLACUSRWUFEKM6A · pith_short_8: CWLACUSR

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/CWLACUSRWUFEKM6AMMMAN3MEI5 \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 1596015251b50a4533c0631806ed8447695f4402afde97f760aa83815f3887d3

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "d2107f53416b5be7f0bb6def77a89d29c846e0845f2cb1d2776e3de4e806af70",
    "cross_cats_sorted": [
      "cs.LG"
    ],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2022-05-02T17:49:50Z",
    "title_canon_sha256": "45acb651556d7ed8eb487e5a4ae17192714946bac38d32ca93c68aa2f50bcf5c"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2205.01068",
    "kind": "arxiv",
    "version": 4
  }
}