Paper Citation Record · LEDGER

Pruned BPE: Post-training Visibility Pruning and Token Reallocation for Byte Pair Encoding

As of 22 August 2026, this Paper Citation Record lists 21 of 21 outbound references and 0 inbound Pith citation observations for arXiv:2608.00837.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2608.00837 v2

Coverage vector

measured 21 of 21 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-15T15:22:58.154641Z

measured 21 of 21 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-22T06:32:14.747728+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

21 of 21 outbound references displayed

verified exact0
verified fuzzy0
unresolved20
parse uncertain0
malformed identifier1
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation faaa7143-9047-4aa7-a069-2e866af3b755 · outbound

This paper cites A new algorithm for data compression.

Pruned BPE: Post-training Visibility Pruning and Token Reallocation for Byte Pair Encoding A new algorithm for data compression

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-15T15:22:58.033543Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d82c0d3c-e4c5-4b49-bc93-2e7813b23ce1 · outbound

This paper cites Neural machine translation of rare words with subword units.

Pruned BPE: Post-training Visibility Pruning and Token Reallocation for Byte Pair Encoding Neural machine translation of rare words with subword units

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-15T15:22:58.039429Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 873601fb-b60f-4c25-a082-40654e683900 · outbound

This paper cites Language models are unsupervised multitask learners.

Pruned BPE: Post-training Visibility Pruning and Token Reallocation for Byte Pair Encoding Language models are unsupervised multitask learners

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-15T15:22:58.044887Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1ffe6396-6d47-4e4d-a6fe-3285572f200f · outbound

This paper cites Llama 3 tokenizer implementation.

Pruned BPE: Post-training Visibility Pruning and Token Reallocation for Byte Pair Encoding Llama 3 tokenizer implementation

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-15T15:22:58.049940Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7564475a-1176-4e86-98e3-4d6b35f9c9c1 · outbound

This paper cites Qwen Technical Report.

Pruned BPE: Post-training Visibility Pruning and Token Reallocation for Byte Pair Encoding Qwen Technical Report

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-15T15:22:58.055363Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ce53621b-2cb0-4aa4-a47e-04fb79b72d60 · outbound

This paper cites Qwen3 Technical Report.

Pruned BPE: Post-training Visibility Pruning and Token Reallocation for Byte Pair Encoding Qwen3 Technical Report

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-15T15:22:58.061331Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0e698b3e-2524-4207-9f13-e1ede01c46ce · outbound

This paper cites Tokenization: v3 tokenizer.

Pruned BPE: Post-training Visibility Pruning and Token Reallocation for Byte Pair Encoding Tokenization: v3 tokenizer

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-15T15:22:58.067456Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 85ee7408-4974-40a2-b9cb-2f11cbe5c961 · outbound

This paper cites an unresolved cited work.

Pruned BPE: Post-training Visibility Pruning and Token Reallocation for Byte Pair Encoding Unresolved cited work

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-15T15:22:58.073747Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7fec7724-c998-4cb0-9032-dae3498a0172 · outbound

This paper cites RoBERTa: A Robustly Optimized BERT Pretraining Approach.

Pruned BPE: Post-training Visibility Pruning and Token Reallocation for Byte Pair Encoding RoBERTa: A Robustly Optimized BERT Pretraining Approach

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-15T15:22:58.079526Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 73be7917-029e-4f75-9848-960f139e4af2 · outbound

This paper cites SentencePiece: A simple and language independent subword tok- enizer and detokenizer for neural text processing.

Pruned BPE: Post-training Visibility Pruning and Token Reallocation for Byte Pair Encoding SentencePiece: A simple and language independent subword tok- enizer and detokenizer for neural text processing

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-15T15:22:58.085527Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 38b393ab-db2f-497b-8eef-a845730606f7 · outbound

This paper cites BPE-Dropout: Simple and effective subword regularization.

Pruned BPE: Post-training Visibility Pruning and Token Reallocation for Byte Pair Encoding BPE-Dropout: Simple and effective subword regularization

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-15T15:22:58.094622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ee53964c-6625-48de-8112-029d80bd3fc5 · outbound

This paper cites Scaffold-BPE: Enhancing byte pair encoding for large language models with simple and effective scaffold token removal.

Pruned BPE: Post-training Visibility Pruning and Token Reallocation for Byte Pair Encoding Scaffold-BPE: Enhancing byte pair encoding for large language models with simple and effective scaffold token removal

Reference 12

Resolution: malformed identifier; no resolver link, observed 2026-08-15T15:22:58.100898Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9592eff8-ca3d-4254-9099-a77419a459a8 · outbound

This paper cites An Analysis of BPE Vocabulary Trimming in Neural Machine Translation.

Pruned BPE: Post-training Visibility Pruning and Token Reallocation for Byte Pair Encoding An Analysis of BPE Vocabulary Trimming in Neural Machine Translation

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-15T15:22:58.106242Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e5f75321-610b-49bc-b475-8b7d6f5cf1c8 · outbound

This paper cites The FineWeb datasets: Decanting the web for the finest text data at scale.

Pruned BPE: Post-training Visibility Pruning and Token Reallocation for Byte Pair Encoding The FineWeb datasets: Decanting the web for the finest text data at scale

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-15T15:22:58.111597Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c369c8f9-026a-4f0c-9511-db965eebd76e · outbound

This paper cites Updated Reddit comment dataset as torrents.

Pruned BPE: Post-training Visibility Pruning and Token Reallocation for Byte Pair Encoding Updated Reddit comment dataset as torrents

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-15T15:22:58.117230Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b079fe7c-762b-4d09-bd2c-9606edd4fd33 · outbound

This paper cites News dataset available.

Pruned BPE: Post-training Visibility Pruning and Token Reallocation for Byte Pair Encoding News dataset available

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-15T15:22:58.123287Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2d380ef2-db72-48cd-bc1b-82f75249b693 · outbound

This paper cites an unresolved cited work.

Pruned BPE: Post-training Visibility Pruning and Token Reallocation for Byte Pair Encoding Unresolved cited work

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-15T15:22:58.129238Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5c8c0376-fd5f-42e4-ba05-7a510be528a9 · outbound

This paper cites THUCTC: An Eﬀicient Chinese Text Classifier.

Pruned BPE: Post-training Visibility Pruning and Token Reallocation for Byte Pair Encoding THUCTC: An Eﬀicient Chinese Text Classifier

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-15T15:22:58.134922Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d1d13cbf-f074-4e73-ac21-9473a9dedb8e · outbound

This paper cites Pruned BPE Tokenizer: Python/Cython implementation, corpus data, and trained tokenizers.

Pruned BPE: Post-training Visibility Pruning and Token Reallocation for Byte Pair Encoding Pruned BPE Tokenizer: Python/Cython implementation, corpus data, and trained tokenizers

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-15T15:22:58.142140Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a05571b9-8484-4399-a65f-4ea8b613087d · outbound

This paper cites Schmidt, Chris Tanner, and Yuval Pinter.

Pruned BPE: Post-training Visibility Pruning and Token Reallocation for Byte Pair Encoding Schmidt, Chris Tanner, and Yuval Pinter

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-15T15:22:58.148248Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b3d87f0d-1fee-45eb-aded-f47260c38f4f · outbound

This paper cites Schmidt, Varshini Reddy, Haoran Zhang, Alec Alameddine, Omri Uzan, Yuval Pinter, and Chris Tanner.

Pruned BPE: Post-training Visibility Pruning and Token Reallocation for Byte Pair Encoding Schmidt, Varshini Reddy, Haoran Zhang, Alec Alameddine, Omri Uzan, Yuval Pinter, and Chris Tanner

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-15T15:22:58.154641Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.