pith:AWMSQSXD
A Calculus-Based Framework for Determining Vocabulary Size in End-to-End ASR
Calculus locates the optimal vocabulary size for end-to-end ASR by fitting a cost curve and applying derivative tests.
arxiv:2605.14427 v1 · 2026-05-14 · cs.CL · cs.SD
Add to your LaTeX paper
\usepackage{pith}
\pithnumber{AWMSQSXDDX6SNWCV64B6F4QOQS}
Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge
Record completeness
Claims
We demonstrate the utility and usefulness of our approach by applying it on a standard Librispeech corpus and show that the optimal choice of vocabulary size hyper-parameter improves the performance of the ASR.
That a curve fitted to the cost function data will have a differentiable minimum identifiable by first and second derivative tests, and that this mathematical optimum will produce measurably better ASR performance on held-out data.
Curve fitting and calculus derivative tests on a tokenization cost function identify an optimal vocabulary size that improves end-to-end ASR performance on Librispeech.
References
Formal links
Receipt and verification
| First computed | 2026-05-17T23:39:07.178032Z |
|---|---|
| Builder | pith-number-builder-2026-05-17-v1 |
| Signature | Pith Ed25519
(pith-v1-2026-05) · public key |
| Schema | pith-number/v1.0 |
Canonical hash
0599284ae31dfd26d855f703e2f20e8483234d8af7c4c39ed2544458fe2615f5
Aliases
· · · · ·Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/AWMSQSXDDX6SNWCV64B6F4QOQS \
| jq -c '.canonical_record' \
| python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 0599284ae31dfd26d855f703e2f20e8483234d8af7c4c39ed2544458fe2615f5
Canonical record JSON
{
"metadata": {
"abstract_canon_sha256": "5bf7faaf0e93efbb9506f9eaf5ad242fe9961b64fed10b773131c4a36cf96330",
"cross_cats_sorted": [
"cs.SD"
],
"license": "http://creativecommons.org/licenses/by/4.0/",
"primary_cat": "cs.CL",
"submitted_at": "2026-05-14T06:19:42Z",
"title_canon_sha256": "02173003b7a20c7ba5fa0b8df3d30825fb729eb4ed6a974c3aa1421b70248b53"
},
"schema_version": "1.0",
"source": {
"id": "2605.14427",
"kind": "arxiv",
"version": 1
}
}