Pith. sign in

Paper Citation Record · LEDGER

How do different tokenizers perform on downstream tasks in scriptio continua languages?: A case study in Japanese

As of 18 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 1 inbound Pith citation observation for arXiv:2306.09572.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2306.09572 v1

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 1 of 1 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-15T19:47:59.544491Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-15T19:48:00.348518Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 0a21da18-f050-4a52-be61-65550e9a292c · inbound

Thunder-Tok: Minimizing Tokens per Word in Tokenizing Korean Texts for Generative Language Models cites this paper.

Thunder-Tok: Minimizing Tokens per Word in Tokenizing Korean Texts for Generative Language Models How do different tokenizers perform on downstream tasks in scriptio continua languages?: A case study in Japanese

Reference 9

Resolution
verified exact
local_arxiv, observed 2026-08-15T19:48:00.353839Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-15T19:47:59.544491Z digest=sha256:7ab700004e3adf588c226dc6dfa11b76fe27a14827e449a166ca971d312c2a4e