Pith. sign in
Pith Number

pith:KM6EM2C5

pith:2026:KM6EM2C5WHSI725UV474S3CVDQ
not attested not anchored not stored refs resolved

Ministral 3

Abhinav Rastogi, Adrien Sad\'e, Alan Jeffares, Albert Jiang, Alexander H. Liu, Alexandre Cahill, Alexandre Gavaudan, Alexandre Sablayrolles, Am\'elie H\'eliou, Amos You, Andy Ehrenberg, Andy Lo, Anton Eliseev, Antonia Calvi, Avinash Sooriyarachchi, Baptiste Bout, Baptiste Rozi\`ere, Baudouin De Monicault, Cl\'emence Lanfranchi, Corentin Barreau, Cyprien Courtot, Daniele Grattarola, Darius Dabert, Diego de las Casas, Elliot Chane-Sane, Faruk Ahmed, Gabrielle Berrada, Ga\"etan Ecrepont, Gauthier Guinet, Georgii Novikov, Guillaume Kunsch, Guillaume Lample, Guillaume Martin, Gunshi Gupta, Jan Ludziejewski, Jason Rute, Joachim Studnia, Jonas Amar, Jos\'ephine Delas, Josselin Somerville Roberts, Karmesh Yadav, Kartik Khandelwal, Khyathi Chandu, Kush Jain, Laurence Aitchison, Laurent Fainsin, L\'eonard Blier, Lingxiao Zhao, Louis Martin, Lucile Saulnier, Luyu Gao, Maarten Buyl, Margaret Jennings, Marie Pellat, Mark Prins, Mathieu Poir\'ee, Mathilde Guillaumin, Matthieu Dinot, Matthieu Futeral, Maxime Darrin, Maximilian Augustin, Mia Chiquier, Michel Schimpf, Nathan Grinsztajn, Neha Gupta, Nikhil Raghuraman, Olivier Bousquet, Olivier Duchenne, Patricia Wang, Patrick von Platen, Paula Kurylowicz, Paul Jacob, Paul Wambergue, Pavankumar Reddy Muddireddy, Philom\`ene Chagniot, Pierre Stock, Pravesh Agrawal, Quentin Torroba, Romain Sauvestre, Roman Soletskyi, Rupert Menneer, Sagar Vaze, Samuel Barry, Sanchit Gandhi, Sandeep Subramanian, Siddhant Waghjale, Siddharth Gandhi, Soham Ghosh, Srijan Mishra, Sumukh Aithal, Szymon Antoniak, Teven Le Scao, Th\'eo Cachet, Theo Simon Sorg, Thibaut Lavril, Thiziri Nait Saada, Thomas Chabal, Thomas Foubert, Thomas Robert, Thomas Wang, Tim Lawson, Tom Bewley, Tom Edwards, Umar Jamil, Umberto Tomasini, Valeriia Nemychnikova, Van Phung, Victor Jouault, Vincent Maladi\`ere, Virgile Richard, Wassim Bouaziz, Wen-Ding Li, William Marshall, Xinghui Li, Xinyu Yang, Yassine El Ouahidi, Yihan Wang, Yunhao Tang, Zaccharie Ramzi

Ministral 3 derives 3B, 8B, and 14B dense models through iterative pruning and distillation for constrained hardware.

arxiv:2601.08584 v1 · 2026-01-13 · cs.CL

Add to your LaTeX paper
\usepackage{pith}
\pithnumber{KM6EM2C5WHSI725UV474S3CVDQ}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp
2 Internet Archive
3 Author claim open · sign in to claim
4 Citations open
5 Replications open
Portable graph bundle live · download bundle · merged state
The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Claims

C1strongest claim

We introduce the Ministral 3 series, a family of parameter-efficient dense language models designed for compute and memory constrained applications, available in three model sizes: 3B, 8B, and 14B parameters... we present our recipe to derive the Ministral 3 models through Cascade Distillation, an iterative pruning and continued training with distillation technique.

C2weakest assumption

That the cascade distillation process produces models that retain high capability in instruction following, reasoning, and image understanding at the stated parameter counts, an assumption with no supporting benchmarks or details in the abstract.

C3one line summary

Ministral 3 releases 3B/8B/14B parameter-efficient language models with base, instruction, and reasoning variants derived via iterative pruning and distillation, including image understanding capabilities.

References

29 extracted · 29 resolved · 18 Pith anchors

[1] Pixtral 12b.arXiv preprint arXiv:2410.07073, · arXiv:2410.07073
[2] GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints · arXiv:2305.13245
[3] Program Synthesis with Large Language Models · arXiv:2108.07732
[4] Qwen3-VL Technical Report · arXiv:2511.21631
[5] Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge · arXiv:1803.05457

Formal links

2 machine-checked theorem links

Cited by

96 papers in Pith

Receipt and verification
First computed 2026-05-17T23:39:22.100132Z
Builder pith-number-builder-2026-05-17-v1
Signature Pith Ed25519 (pith-v1-2026-05) · public key
Schema pith-number/v1.0

Canonical hash

533c46685db1e48febb4af3fc96c551c311987b0089c4edd6f7b9440140b1f4f

Aliases

arxiv: 2601.08584 · arxiv_version: 2601.08584v1 · doi: 10.48550/arxiv.2601.08584 · pith_short_12: KM6EM2C5WHSI · pith_short_16: KM6EM2C5WHSI725U · pith_short_8: KM6EM2C5
Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/KM6EM2C5WHSI725UV474S3CVDQ \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 533c46685db1e48febb4af3fc96c551c311987b0089c4edd6f7b9440140b1f4f
Canonical record JSON
{
  "metadata": {
    "abstract_canon_sha256": "05566ea0f28de231307f468396cef8930f0398478ba66bab1d812f4188526a69",
    "cross_cats_sorted": [],
    "license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2026-01-13T14:06:03Z",
    "title_canon_sha256": "e55b37022259303e5ae01de25691fecc43df97bbcb774ea08d74f8836badb09f"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2601.08584",
    "kind": "arxiv",
    "version": 1
  }
}