Pith. sign in

Paper Citation Record · LEDGER

Byte Pair Encoding is Suboptimal for Language Model Pretraining

As of 8 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 3 inbound Pith citation observations for arXiv:2004.03720.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2004.03720 v2

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 3 of 3 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 3 of 3 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T14:56:44.277726Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T04:39:34.580127Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 2354ad57-c2db-4543-93a7-5f74cd55ecca · inbound

Comparative analysis of subword tokenization approaches for Indian languages cites this paper.

Comparative analysis of subword tokenization approaches for Indian languages Byte Pair Encoding is Suboptimal for Language Model Pretraining

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-07T14:56:44.277726Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T14:56:44.277726Z digest=sha256:48c97e5dba61ddfc42e1b00f27cf29d7def33c1516c52b3e31074f5b3f02a1e4

Observation 59e3d09c-ba78-49d8-95dc-f471f4e5c919 · inbound

Incorporating Domain Knowledge into Materials Tokenization cites this paper.

Incorporating Domain Knowledge into Materials Tokenization Byte Pair Encoding is Suboptimal for Language Model Pretraining

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T05:38:22.245808Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T05:38:22.245808Z digest=sha256:3636ab321bea99852b89278612d22d4df93dbb0e959f217ad7c0c0345ada9e76

Observation fdc02c0f-a02b-40c0-ba19-93d4aec67cc8 · inbound

Phonemes to the Rescue: Multilingual Tokenization Based on International Phonetic Alphabet cites this paper.

Phonemes to the Rescue: Multilingual Tokenization Based on International Phonetic Alphabet Byte Pair Encoding is Suboptimal for Language Model Pretraining

Reference 9

Resolution
verified exact
arxiv_id, observed 2026-07-04T04:39:34.581473Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-06-26T16:53:25.556222Z digest=sha256:7b30c09ad0aca7545240502c469105e0740cec942ba474290e7a2b8406d446a8