Pith. sign in

Paper Citation Record · LEDGER

BPE Gets Picky: Efficient Vocabulary Refinement During Tokenizer Training

As of 17 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 2 inbound Pith citation observations for arXiv:2409.04599.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2409.04599 v1

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 2 of 2 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-17T06:30:58.91139+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-12T15:29:49.179745Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-19T09:53:02.103894Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 4568cb6f-3349-4041-ad63-a16c98614005 · inbound

Why do language models perform worse for morphologically complex languages? cites this paper.

Why do language models perform worse for morphologically complex languages? BPE Gets Picky: Efficient Vocabulary Refinement During Tokenizer Training

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-12T15:29:49.179745Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-12T15:29:49.179745Z digest=sha256:e87bf0f47495667ad22fa2995a853aa5726a67ffff1f5e7dfd740c5acaf59d19

Observation 16ebc47e-0de3-438d-a5ab-d77cd14779a0 · inbound

Sampling from Your Language Model One Byte at a Time cites this paper.

Sampling from Your Language Model One Byte at a Time BPE Gets Picky: Efficient Vocabulary Refinement During Tokenizer Training

Reference 10

Resolution
verified exact
arxiv_id, observed 2026-05-19T09:53:02.106060Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-05-19T09:52:20.923710Z digest=sha256:2b04660564be259fd75e2a3a8cb7a9f300015c8e62db82a6b09f0d011be6bca8