Paper Citation Record · LEDGER

ByteSpan: Information-Driven Subword Tokenisation

As of 22 August 2026, this Paper Citation Record lists 48 of 48 outbound references and 1 inbound Pith citation observation for arXiv:2506.18639.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.18639 v1

Coverage vector

measured 48 of 48 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T23:20:55.975121Z

measured 49 of 49 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-22T06:32:14.747728+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-10T18:51:20.043728Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-10T23:50:52.393677Z

Reference resolution

48 of 48 outbound references displayed

verified exact11
verified fuzzy10
unresolved27
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation d4d40306-5aec-418c-ab51-bff99eda52d8 · outbound

This paper cites Exploring BERT 's vocabulary, 2019.

ByteSpan: Information-Driven Subword Tokenisation Exploring BERT 's vocabulary, 2019

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:21:02.168345Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 6c86e1f8-1343-4a5a-af59-320ebde1cb24 · outbound

This paper cites M orphy N et: A large multilingual database of derivational and inflectional morphology.

ByteSpan: Information-Driven Subword Tokenisation M orphy N et: A large multilingual database of derivational and inflectional morphology

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:50.556987Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 380b1639-fa6c-4f48-afa2-8a78d5b07630 · outbound

This paper cites G., Ryskina, M., Mielke, S., Budianskaya, E., El-Khaissi, C., Pimentel, T., Gasser, M., Lane, W.

ByteSpan: Information-Driven Subword Tokenisation G., Ryskina, M., Mielke, S., Budianskaya, E., El-Khaissi, C., Pimentel, T., Gasser, M., Lane, W

Reference 3

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:21:01.965685Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 4c6a3187-d0f0-4a5b-b1f5-0a62df382130 · outbound

This paper cites and Pinter, Y.

ByteSpan: Information-Driven Subword Tokenisation and Pinter, Y

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:50.744745Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 758c2f7e-421c-4bec-beb0-d1ae8b15481e · outbound

This paper cites an unresolved cited work.

ByteSpan: Information-Driven Subword Tokenisation Unresolved cited work

Reference 5

Resolution: verified exact; doi, observed 2026-08-06T23:20:58.769635Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation a5361ed9-6ea8-4f08-b82f-a2852ec00772 · outbound

This paper cites Tokenization falling short: O n subword robustness in large language models.

ByteSpan: Information-Driven Subword Tokenisation Tokenization falling short: O n subword robustness in large language models

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:50.963708Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4c3f15e9-b75e-48ed-a665-dad23eda1738 · outbound

This paper cites H., Allen, J., and Seidenberg, M.

ByteSpan: Information-Driven Subword Tokenisation H., Allen, J., and Seidenberg, M

Reference 7

Resolution: verified exact; doi, observed 2026-08-06T23:20:58.484580Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 5633407a-36bc-4006-ae3b-a878eb782921 · outbound

This paper cites and Nerbonne, J.

ByteSpan: Information-Driven Subword Tokenisation and Nerbonne, J

Reference 8

Resolution: verified exact; doi, observed 2026-08-06T23:20:58.287179Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation aad3ec9f-21b2-47a6-95e0-7cb917a9f041 · outbound

This paper cites an unresolved cited work.

ByteSpan: Information-Driven Subword Tokenisation Unresolved cited work

Reference 9

Resolution: unresolved; raw_fallback, observed 2026-08-06T23:21:01.834731Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 4f404ffd-daba-4488-8d9d-139799d036b8 · outbound

This paper cites an unresolved cited work.

ByteSpan: Information-Driven Subword Tokenisation Unresolved cited work

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:51.461949Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e30d1526-9b72-4cea-ac11-7aa39412eb75 · outbound

This paper cites L., Spalding, T.

ByteSpan: Information-Driven Subword Tokenisation L., Spalding, T

Reference 11

Resolution: verified exact; doi, observed 2026-08-06T23:20:58.164614Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 6c07660e-a183-44c0-af41-032c6850d8ab · outbound

This paper cites Splintering Nonconcatenative Languages for Better Tokenization.

ByteSpan: Information-Driven Subword Tokenisation Splintering Nonconcatenative Languages for Better Tokenization

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:51.698108Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 454aac8c-3729-42af-9ace-be3836f8b710 · outbound

This paper cites BabyLM's First Words: Word Segmentation as a Phonological Probing Task.

ByteSpan: Information-Driven Subword Tokenisation BabyLM's First Words: Word Segmentation as a Phonological Probing Task

Reference 13

Resolution: verified exact; local_arxiv, observed 2026-08-06T23:20:59.824686Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation e1f5b2fd-2311-41e4-9ae4-a3fc189880d2 · outbound

This paper cites Word segmentation from transcriptions of child-directed speech using lexical and sub-lexical cues.

ByteSpan: Information-Driven Subword Tokenisation Word segmentation from transcriptions of child-directed speech using lexical and sub-lexical cues

Reference 14

Resolution: verified exact; doi, observed 2026-08-06T23:20:57.906313Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 977606a9-505c-4387-9fb5-50cbc965660e · outbound

This paper cites Improving tokenisation by alternative treatment of spaces.

ByteSpan: Information-Driven Subword Tokenisation Improving tokenisation by alternative treatment of spaces

Reference 15

Resolution: verified exact; doi, observed 2026-08-06T23:20:57.699146Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 6dd0e1c2-24e9-4ef9-ba8a-1e936be536b7 · outbound

This paper cites an unresolved cited work.

ByteSpan: Information-Driven Subword Tokenisation Unresolved cited work

Reference 16

Resolution: unresolved; raw_fallback, observed 2026-08-06T23:21:01.711333Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 674695cd-b193-42fd-9170-fc5cb1c89a70 · outbound

This paper cites D ago BERT : G enerating derivational morphology with a pretrained language model.

ByteSpan: Information-Driven Subword Tokenisation D ago BERT : G enerating derivational morphology with a pretrained language model

Reference 17

Resolution: verified exact; doi, observed 2026-08-06T23:20:57.464412Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 38f0f2f5-295f-44f1-ae76-e6c1d5d14ffe · outbound

This paper cites MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies.

ByteSpan: Information-Driven Subword Tokenisation MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:52.416447Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 47c4f376-ae3f-42dd-9a9d-93a8e2b05b71 · outbound

This paper cites Lost in Space Marking.

ByteSpan: Information-Driven Subword Tokenisation Lost in Space Marking

Reference 19

Resolution: verified exact; local_arxiv, observed 2026-08-06T23:20:59.507164Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation a69bde22-87cd-4b7b-9563-486cfafb349e · outbound

This paper cites The MiniPile Challenge for Data-Efficient Language Models.

ByteSpan: Information-Driven Subword Tokenisation The MiniPile Challenge for Data-Efficient Language Models

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:52.816970Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 62f486a7-81f2-47f8-8355-66410540322d · outbound

This paper cites Adam: A Method for Stochastic Optimization.

ByteSpan: Information-Driven Subword Tokenisation Adam: A Method for Stochastic Optimization

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:52.930480Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 72692b47-a437-4084-a287-a007c5468f80 · outbound

This paper cites Subword regularization: Improving neural network translation models with multiple subword candidates.

ByteSpan: Information-Driven Subword Tokenisation Subword regularization: Improving neural network translation models with multiple subword candidates

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:53.064748Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 05069aec-755d-42cf-a5ed-91632af5d35c · outbound

This paper cites The Common Corpus : A new massively multilingual dataset, September 2021.

ByteSpan: Information-Driven Subword Tokenisation The Common Corpus : A new massively multilingual dataset, September 2021

Reference 23

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:21:01.539385Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 9dca9e2d-266d-4176-8dd2-ce7959edc41f · outbound

This paper cites MYTE : Morphology-driven byte encoding for better and fairer multilingual language modeling.

ByteSpan: Information-Driven Subword Tokenisation MYTE : Morphology-driven byte encoding for better and fairer multilingual language modeling

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:53.256141Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cc8af55c-86a4-412a-a5df-ed4b876d63ab · outbound

This paper cites and Hutter, F.

ByteSpan: Information-Driven Subword Tokenisation and Hutter, F

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:53.547939Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cfb40576-7d5f-46b7-ad52-a5a4810feb2f · outbound

This paper cites The acquisition of morphophonology.

ByteSpan: Information-Driven Subword Tokenisation The acquisition of morphophonology

Reference 26

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:21:01.328853Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 3c5e7032-7d29-4007-b448-627ea77750d0 · outbound

This paper cites C ompound P iece: E valuating and improving decompounding performance of language models.

ByteSpan: Information-Driven Subword Tokenisation C ompound P iece: E valuating and improving decompounding performance of language models

Reference 27

Resolution: verified exact; doi, observed 2026-08-06T23:20:57.155446Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation b6ae425c-8731-4335-ad2f-240166d6bc27 · outbound

This paper cites Hierarchical transformers are more efficient language models.

ByteSpan: Information-Driven Subword Tokenisation Hierarchical transformers are more efficient language models

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:53.869265Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f27b28ee-812e-48ab-9b93-432a11278d35 · outbound

This paper cites an unresolved cited work.

ByteSpan: Information-Driven Subword Tokenisation Unresolved cited work

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:53.974889Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1db18ae7-1465-44d1-bff7-ba515ca024bd · outbound

This paper cites Byte Latent Transformer: Patches Scale Better Than Tokens.

ByteSpan: Information-Driven Subword Tokenisation Byte Latent Transformer: Patches Scale Better Than Tokens

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:54.053549Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 56b2de42-65bd-4040-9826-5d1831615a41 · outbound

This paper cites PyTorch : A n imperative style, high-performance deep learning library.

ByteSpan: Information-Driven Subword Tokenisation PyTorch : A n imperative style, high-performance deep learning library

Reference 31

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:21:01.148556Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation a7d32713-b54b-4143-9e1c-cd664fa0d04e · outbound

This paper cites B., Lozhkov, A., Mitchell, M., Raffel, C., Werra, L.

ByteSpan: Information-Driven Subword Tokenisation B., Lozhkov, A., Mitchell, M., Raffel, C., Werra, L

Reference 32

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:21:00.957413Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 6c86c14a-e716-4e4a-801f-9554db0deee8 · outbound

This paper cites L., and Eisenstein, J.

ByteSpan: Information-Driven Subword Tokenisation L., and Eisenstein, J

Reference 33

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:21:00.694185Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation f6e83283-7d5f-45b9-bf70-fe7b0137b2bb · outbound

This paper cites How Good is Your Tokenizer ? On the Monolingual Performance of Multilingual Language Models.

ByteSpan: Information-Driven Subword Tokenisation How Good is Your Tokenizer ? On the Monolingual Performance of Multilingual Language Models

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:54.503664Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 120a1001-3ed5-48bf-82ca-105e944ffd02 · outbound

This paper cites R., Aslin, R.

ByteSpan: Information-Driven Subword Tokenisation R., Aslin, R

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:54.642466Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bb3c5365-4cfc-4c81-be79-c87b95d2c145 · outbound

This paper cites H., Mailhot, H., Deacon, S.

ByteSpan: Information-Driven Subword Tokenisation H., Mailhot, H., Deacon, S

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:54.713652Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6a1e7009-5686-41bf-9447-ff03782785e5 · outbound

This paper cites and Nakajima, K.

ByteSpan: Information-Driven Subword Tokenisation and Nakajima, K

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:54.846333Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 061eefea-7d53-47a3-b687-6579133439b8 · outbound

This paper cites Neural machine translation of rare words with subword units.

ByteSpan: Information-Driven Subword Tokenisation Neural machine translation of rare words with subword units

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:54.928612Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1a730f6b-ca43-4041-bc71-9c932ca47eaf · outbound

This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.

ByteSpan: Information-Driven Subword Tokenisation Llama 2: Open Foundation and Fine-Tuned Chat Models

Reference 39

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:55.045829Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e9091c2b-9f98-4585-b6ed-750ef45bccf9 · outbound

This paper cites W., Tanner, C., and Pinter, Y.

ByteSpan: Information-Driven Subword Tokenisation W., Tanner, C., and Pinter, Y

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:55.140561Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c291be60-ca36-4737-b27f-db26345870b2 · outbound

This paper cites N., Kaiser, L.

ByteSpan: Information-Driven Subword Tokenisation N., Kaiser, L

Reference 41

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:21:00.506658Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation d8e5441e-ec95-4b69-b744-9561a17e22e7 · outbound

This paper cites A statistical model for word discovery in transcribed speech.

ByteSpan: Information-Driven Subword Tokenisation A statistical model for word discovery in transcribed speech

Reference 42

Resolution: verified exact; doi, observed 2026-08-06T23:20:56.536684Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation f4c2c36d-f3a4-4f46-9adf-ed9e86647da6 · outbound

This paper cites an unresolved cited work.

ByteSpan: Information-Driven Subword Tokenisation Unresolved cited work

Reference 43

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:55.434745Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c175f1fc-bcb7-4348-ade2-8c41d48d21d6 · outbound

This paper cites Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective.

ByteSpan: Information-Driven Subword Tokenisation Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape Perspective

Reference 44

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:55.558998Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6e0ff8be-f08b-4386-9fb9-fd70340e2da9 · outbound

This paper cites Transformers: S tate-of-the-art natural language processing.

ByteSpan: Information-Driven Subword Tokenisation Transformers: S tate-of-the-art natural language processing

Reference 45

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:55.705673Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 49553dfa-9798-4aeb-96c7-09c1a7a0ba04 · outbound

This paper cites MEGABYTE : P redicting million-byte sequences with multiscale transformers.

ByteSpan: Information-Driven Subword Tokenisation MEGABYTE : P redicting million-byte sequences with multiscale transformers

Reference 46

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:21:00.250613Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 654b7a45-51c1-45ca-9b55-cf9c015beb7d · outbound

This paper cites Scaling vision transformers.

ByteSpan: Information-Driven Subword Tokenisation Scaling vision transformers

Reference 47

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T23:21:00.060704Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation e1ed16cf-d107-4930-a223-b09f2101233f · outbound

This paper cites Tokenization and the noiseless channel.

ByteSpan: Information-Driven Subword Tokenisation Tokenization and the noiseless channel

Reference 48

Resolution: unresolved; no resolver link, observed 2026-08-06T23:20:55.975121Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation e052c859-f830-44e6-bc1e-352cbf49d08f · inbound

Faster Superword Tokenization cites this paper.

Faster Superword Tokenization ByteSpan: Information-Driven Subword Tokenisation

Reference 4

Resolution: verified exact; arxiv_id, observed 2026-05-10T23:50:52.401239Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.