Paper Citation Record · LEDGER

Tokenization Matters: Improving Zero-Shot NER for Indic Languages

As of 21 August 2026, this Paper Citation Record lists 33 of 33 outbound references and 4 inbound Pith citation observations for arXiv:2504.16977.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2504.16977 v1

Coverage vector

measured 33 of 33 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-16T10:55:55.472875Z

measured 37 of 37 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-21T06:32:19.484+00:00

measured 4 of 4 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-10T23:55:17.570331Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-07T11:35:19.928065Z

Reference resolution

33 of 33 outbound references displayed

verified exact2
verified fuzzy19
unresolved12
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation c9e1467e-0ec8-42d1-a049-8daaac4a6dba · outbound

This paper cites Census of india 2011: Data on language and mother tongue,.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Census of india 2011: Data on language and mother tongue,

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:55:55.954887Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation a36e224b-5076-4af4-b8b1-dacb0b773152 · outbound

This paper cites Eighth schedule to the constitution of india,.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Eighth schedule to the constitution of india,

Reference 2

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:55:55.943095Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation ef213086-f0a6-4a3c-bd92-319a355af6da · outbound

This paper cites Review of reference generation methods in large language models,.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Review of reference generation methods in large language models,

Reference 3

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:55:55.930685Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation a79e69e9-c53c-4e5f-906b-a65a4233a503 · outbound

This paper cites Retrofitting language models with dynamic tokenisation,.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Retrofitting language models with dynamic tokenisation,

Reference 4

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:55:55.919468Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation ff900633-a840-4e46-bc57-abbc82b16550 · outbound

This paper cites Clinical QA 2.0: Multi-Task Learning for Answer Extraction and Categorization.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Clinical QA 2.0: Multi-Task Learning for Answer Extraction and Categorization

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-16T10:55:55.363340Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a879e7c6-2615-4359-bca8-9e8093af8534 · outbound

This paper cites Neural machine translation of rare words with subword units,.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Neural machine translation of rare words with subword units,

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:55:55.908224Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation c34d4be7-2e6b-47fa-af2a-5c9603745d22 · outbound

This paper cites Bert: Pre-training of deep bidirectional transformers for language understanding,.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Bert: Pre-training of deep bidirectional transformers for language understanding,

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:55:55.897329Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 3eebeb5e-72dd-46cd-b3d8-985dd6919b9a · outbound

This paper cites Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic Languages.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic Languages

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-16T10:55:55.376348Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 08629775-0382-4f57-8135-a0052f8be52e · outbound

This paper cites Un- supervised cross-lingual representation learning at scale,.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Un- supervised cross-lingual representation learning at scale,

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:55:55.885399Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation a087b0a7-3ec9-417c-b6b4-960f7bc59772 · outbound

This paper cites Enhancing Document AI Data Generation Through Graph-Based Synthetic Layouts.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Enhancing Document AI Data Generation Through Graph-Based Synthetic Layouts

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-16T10:55:55.384566Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 23928213-c50c-4df1-a4b3-8a55a04f7eda · outbound

This paper cites Fs-dag: Few shot domain adapting graph networks for visually rich document understanding,.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Fs-dag: Few shot domain adapting graph networks for visually rich document understanding,

Reference 11

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:55:55.873304Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation e21b69e9-faee-4321-b634-de9d7b7cf23b · outbound

This paper cites Continuous Spiking Graph Neural Networks.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Continuous Spiking Graph Neural Networks

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-16T10:55:55.392269Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 566d1c86-965b-4390-9f29-b8486e8d6035 · outbound

This paper cites Sentencepiece: A simple and language inde- pendent subword tokenizer and detokenizer for neural text processing,.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Sentencepiece: A simple and language inde- pendent subword tokenizer and detokenizer for neural text processing,

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:55:55.861382Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation b5e64fd4-877a-4005-8a00-f8bc67595333 · outbound

This paper cites A survey of cross-lingual word embedding models,.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages A survey of cross-lingual word embedding models,

Reference 14

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:55:55.847073Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation ffe1b38d-25ce-4681-bfb4-c9cbfd8284c2 · outbound

This paper cites Survey of Large Multimodal Model Datasets, Application Categories and Taxonomy.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Survey of Large Multimodal Model Datasets, Application Categories and Taxonomy

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-16T10:55:55.403585Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2892dfdc-75a2-482c-b14a-7c5c14a6c5cd · outbound

This paper cites Tokenizers for african languages,.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Tokenizers for african languages,

Reference 16

Resolution: verified exact; raw_fallback, observed 2026-08-16T10:55:55.661203Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 87384943-aeb8-4ca6-ae35-b73445bf01cc · outbound

This paper cites MVTamperBench: Evaluating Robustness of Vision-Language Models.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages MVTamperBench: Evaluating Robustness of Vision-Language Models

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-16T10:55:55.410963Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0c446cb3-4fd4-4329-928c-831ebee2ac50 · outbound

This paper cites Hybrid machine learning and deep learning approaches for insult detection in roman urdu text,.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Hybrid machine learning and deep learning approaches for insult detection in roman urdu text,

Reference 18

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:55:55.834971Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation a092e4ed-44e1-46e1-b0ae-cb18ff71aaa6 · outbound

This paper cites Tokenization Standards for Linguistic Integrity: Turkish as a Benchmark.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Tokenization Standards for Linguistic Integrity: Turkish as a Benchmark

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-16T10:55:55.418419Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 349286a5-fcc5-46f2-96a1-d66c2289ec00 · outbound

This paper cites Pseudo-labelling based boot- strapping for semi supervised learning,.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Pseudo-labelling based boot- strapping for semi supervised learning,

Reference 20

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:55:55.821895Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 53a8a361-9912-4d4c-957f-b283e3e6ed2a · outbound

This paper cites Leveraging cumeta for enhanced document classification in cursive languages with transformer stacking,.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Leveraging cumeta for enhanced document classification in cursive languages with transformer stacking,

Reference 21

Resolution: verified exact; doi, observed 2026-08-16T10:55:55.509222Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation c2bf618e-e22a-4081-b094-421200fc7a45 · outbound

This paper cites Augmented input representations in sequence generation models for decipherment and translation,.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Augmented input representations in sequence generation models for decipherment and translation,

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:55:55.809420Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 412854b0-f140-45fb-8700-23ba039ec514 · outbound

This paper cites LLM for Barcodes: Generating Diverse Synthetic Data for Identity Documents.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages LLM for Barcodes: Generating Diverse Synthetic Data for Identity Documents

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-16T10:55:55.433489Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b76de85d-030c-4995-abe1-c97c8aca35d8 · outbound

This paper cites Indicnlp corpus: Monolingual corpora and word embeddings for indic languages,.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Indicnlp corpus: Monolingual corpora and word embeddings for indic languages,

Reference 24

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:55:55.797412Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation c9f53abe-0a6e-45c9-b8d1-326fd22353f0 · outbound

This paper cites A survey on recent approaches for natural language pro- cessing in low-resource scenarios,.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages A survey on recent approaches for natural language pro- cessing in low-resource scenarios,

Reference 25

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:55:55.784377Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation d960e47c-f474-44b9-8f75-0402fee4a801 · outbound

This paper cites Named entity recognition for indian languages,.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Named entity recognition for indian languages,

Reference 26

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:55:55.772389Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation b3ec6b1c-fc64-4e46-979f-63e3fa5c12af · outbound

This paper cites When every token counts: Optimal segmentation for low-resource language models,.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages When every token counts: Optimal segmentation for low-resource language models,

Reference 27

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:55:55.760413Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 4a8c808c-8042-422a-837a-90d574b726e7 · outbound

This paper cites NER- RoBERTa: Fine-Tuning RoBERTa for Named Entity Recognition (NER) within low-resource languages.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages NER- RoBERTa: Fine-Tuning RoBERTa for Named Entity Recognition (NER) within low-resource languages

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-16T10:55:55.452661Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4932a856-f10c-4cb9-af81-96cdc621db4d · outbound

This paper cites Adaptive subword tokenization for low- resource nlp: Balancing efficiency and generalization,.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Adaptive subword tokenization for low- resource nlp: Balancing efficiency and generalization,

Reference 29

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:55:55.747561Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Observation 472eac41-6e95-4b58-9343-b1c85a10bd84 · outbound

This paper cites When Every Token Counts: Optimal Segmentation for Low-Resource Language Models.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages When Every Token Counts: Optimal Segmentation for Low-Resource Language Models

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-16T10:55:55.460756Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c4439a7f-dcdb-4d4e-bf2a-d9ab3a38a0bc · outbound

This paper cites No Language Left Behind: Scaling Human-Centered Machine Translation.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages No Language Left Behind: Scaling Human-Centered Machine Translation

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-16T10:55:55.464852Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 272ee6f3-2696-477b-95b6-b35f9ba4683f · outbound

This paper cites Naamapadam: A Large-Scale Named Entity Annotated Data for Indic Languages.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Naamapadam: A Large-Scale Named Entity Annotated Data for Indic Languages

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-16T10:55:55.469053Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9a96cd2e-d127-4149-bab2-041e609abca0 · outbound

This paper cites Multiclass text classi- fications of sindhi newspaper articles,.

Tokenization Matters: Improving Zero-Shot NER for Indic Languages Multiclass text classi- fications of sindhi newspaper articles,

Reference 33

Resolution: verified fuzzy; raw_fallback, observed 2026-08-16T10:55:55.734321Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.

Pith citing papers

Observation b0f7d0ad-c704-4370-a2a7-e0e125a09789 · inbound

MVTamperBench: Evaluating Robustness of Vision-Language Models cites this paper.

MVTamperBench: Evaluating Robustness of Vision-Language Models Tokenization Matters: Improving Zero-Shot NER for Indic Languages

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-10T23:55:17.570331Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5b2fa618-4552-4e31-8336-e1f9e5468b8e · inbound

SweEval: Do LLMs Really Swear? A Safety Benchmark for Testing Limits for Enterprise Use cites this paper.

SweEval: Do LLMs Really Swear? A Safety Benchmark for Testing Limits for Enterprise Use Tokenization Matters: Improving Zero-Shot NER for Indic Languages

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-07T14:52:29.703994Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation eb67cc13-93c6-4c67-9743-6163cda58732 · inbound

Hard Negative Mining for Domain-Specific Retrieval in Enterprise Systems cites this paper.

Hard Negative Mining for Domain-Specific Retrieval in Enterprise Systems Tokenization Matters: Improving Zero-Shot NER for Indic Languages

Reference 44

Resolution: unresolved; no resolver link, observed 2026-08-07T14:36:13.135559Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 21c10cc0-8486-461f-be9a-0afc31687822 · inbound

Hybrid AI for Responsive Multi-Turn Online Conversations with Novel Dynamic Routing and Feedback Adaptation cites this paper.

Hybrid AI for Responsive Multi-Turn Online Conversations with Novel Dynamic Routing and Feedback Adaptation Tokenization Matters: Improving Zero-Shot NER for Indic Languages

Reference 28

Resolution: verified exact; local_arxiv, observed 2026-08-07T11:35:20.018282Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-21T06:32:19.484+00:00.