Pith. sign in

Paper Citation Record · LEDGER

The Roles of English in Evaluating Multilingual Language Models

As of 12 August 2026, this Paper Citation Record lists 29 of 29 outbound references and 1 inbound Pith citation observation for arXiv:2412.08392.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2412.08392 v1

Coverage vector

measured 29 of 29 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-11T17:55:10.666794Z

measured 30 of 30 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-12T06:34:41.77262+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-08T15:06:55.213500Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-08T15:06:56.620307Z

Reference resolution

29 of 29 outbound references displayed

  • verified exact0
  • verified fuzzy1
  • unresolved27
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation b3037e3d-a232-40cc-ab68-377717c57b08 · outbound

This paper cites URL: " 'urlintro :=.

The Roles of English in Evaluating Multilingual Language Models URL: " 'urlintro :=

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.573299Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.573299Z digest=sha256:3088171173b7d3a541832ac9160e44a8c9ceec8d8091f8ed5bc53ba67d74e631

Observation 3f627e18-60e4-4fd7-96db-1f76e4d0d04b · outbound

This paper cites write newline.

The Roles of English in Evaluating Multilingual Language Models write newline

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.577295Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.577295Z digest=sha256:eed03169e4c87bdccd173405b838036652cf448f58ee2ad71cd92b847e2d5795

Observation f8881331-d826-4d8c-aad5-b3271f9adf50 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.083851Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.581333Z digest=sha256:c371eed56543a2c6920f20d6c0ada3cb18d8d1582fafceece5f7b473a72e59fa

Observation 6b78d241-0550-4e8d-b8c9-e5ad9abfbdad · outbound

This paper cites IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models.

The Roles of English in Evaluating Multilingual Language Models IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.584655Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.584655Z digest=sha256:bb16949b5f0d18affd76a454b82abf9b08c723942a8028077170462e91e6a9ee

Observation bdd75e9e-4178-4b52-9df2-3b9c24bcb6c6 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.074649Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.588515Z digest=sha256:5276538b771b995dea53a839565d7f49fc97bb8c857796792fa2f91c78ffd273

Observation ff125af0-9abb-4ab2-9d2b-992f16e46831 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.065832Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.591869Z digest=sha256:856a18f6ee5c555f52548da187a1c0fefd999cf72a4666fa5c3bd2b52fbf8ce2

Observation 812b29e0-224b-454b-9460-3c8f446315ae · outbound

This paper cites Lessons from the Trenches on Reproducible Evaluation of Language Models.

The Roles of English in Evaluating Multilingual Language Models Lessons from the Trenches on Reproducible Evaluation of Language Models

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.595259Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.595259Z digest=sha256:57a2614c6f04ecbc1caa867df4055d7322c3cdc7c1d28b9f6af814e85ff17f6b

Observation 39719529-198b-4788-996b-21ca66141b5e · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.056952Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.599181Z digest=sha256:40182f5caef39bcfbb076f3dd19e8b65a1f870c603e7cea357531c8b9243a244

Observation 77174f19-1ec2-4e95-a1ad-530a9f8309ff · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.047315Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.602594Z digest=sha256:d571c5f21e06d983840c0816216a44b4705bd15c8d7981bbc0fa4ec6ecbce68d

Observation 50ae6a8c-cb1b-4c1f-9958-a6a7721ab64a · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.038570Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.605852Z digest=sha256:798f476bbd31fcf6250da9240056c10e53f4931e9c886153944f2ece247079ed

Observation 28b68d3e-4d5c-4e2e-9dcb-9105ba14b097 · outbound

This paper cites How Good Are GPT Models at Machine Translation? A Comprehensive Evaluation.

The Roles of English in Evaluating Multilingual Language Models How Good Are GPT Models at Machine Translation? A Comprehensive Evaluation

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.608871Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.608871Z digest=sha256:7fa099a056ee3319dc78b22f8049316de900c7d430bdbf9bc2541bb3f59d8938

Observation 1034d0d0-0595-4dc9-9bd9-5550f6f3763c · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.030436Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.612347Z digest=sha256:d5319e44a8de18b3587ec625d433abd19a28076211708dfe3213da6be3500a09

Observation 470ac45e-e404-47d3-80d8-18cbc571c0ea · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 13

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.022422Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.615701Z digest=sha256:07fbba21e1f740a6428a70bcc546de7726ae528fe6f7d4847cb7c6a8943c6638

Observation a1332c8b-edcc-4289-8a9a-406a1e975ec1 · outbound

This paper cites o pf, Yannic Kilcher, Dimitri von R \.

The Roles of English in Evaluating Multilingual Language Models o pf, Yannic Kilcher, Dimitri von R \

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T17:55:11.014394Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.618800Z digest=sha256:ddd451d82b46faa235b286fdae12ad5b1ade602b0e26c2da5ca04207f16e0ff9

Observation 9bfb0914-6ed5-4c10-9b4a-7d3157f1cb9e · outbound

This paper cites MaLA-500: Massive Language Adaptation of Large Language Models.

The Roles of English in Evaluating Multilingual Language Models MaLA-500: Massive Language Adaptation of Large Language Models

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.621876Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.621876Z digest=sha256:3d4b6b013810f9b6813dfb6b5b21fe8f20931da7dfbc9fbf2d1ae7de8fa623e8

Observation 2ac7734a-ca2a-4580-8bbb-5364623c4955 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 16

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.005907Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.625398Z digest=sha256:dc0ff62d3f50a93c415873539c3102e5d2019203b5fc497f9164602c176c5c3b

Observation 68888c09-6a55-4967-b849-139d32d04ff8 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 17

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.996925Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.628527Z digest=sha256:83db8940990ccbc8c512c75ebd343640ec8037173528411ed12dec717e5ad454

Observation 127e6c2c-473a-4fe6-90db-2c51f65380f9 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.987730Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.631521Z digest=sha256:2f26078b33e644246149a0af1d8b9aa358e135cd35d69d015d5f9c7871fa2408

Observation 6a41e1b0-e11b-4db7-9f3f-c3623fe56f68 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.977733Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.634537Z digest=sha256:46cc6e9cadcaabb858e68c28daeaf42e83649e2a3b8e5f4df488fa137787da48

Observation 429e1d6c-88f2-4f86-8f28-be71240ca772 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.968309Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.637663Z digest=sha256:88ffc910e039d78d39d1fd8211a9a7aa48feea3edd8e514cdc59c925af183189

Observation a895bc84-0eef-4cd4-ac86-b3e583132d3f · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.958543Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.642124Z digest=sha256:fb562da0a7d7a8dd97f890d258100236d8a8723d913e41c13270601ff4d621b4

Observation 3af72875-7a54-47cd-af1e-57fd6d54fd2a · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.947560Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.645307Z digest=sha256:30bc2b591445b58315a00468d423131e4dac9ce47e835171287f28942b0f8940

Observation 5544f47c-1a80-4f5e-bbaf-be3cc288e9c5 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.938077Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.648446Z digest=sha256:056025cf23c94fd9bdaf23dcdcdc018dfac0eefe94673dc7645a803de4c9e497

Observation 8674580a-c8e5-4fe0-91da-23e4e7ef1042 · outbound

This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.

The Roles of English in Evaluating Multilingual Language Models Llama 2: Open Foundation and Fine-Tuned Chat Models

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.651637Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.651637Z digest=sha256:113a500ea1dab1968c358108e3d72ebf2bbea7d9160a61e0de8e78e85f4e22a0

Observation 734c96f4-c839-4bde-b0a7-d1eb0faf51fb · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 25

Resolution
metadata mismatch
raw_fallback, observed 2026-08-11T17:55:10.856385Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.655251Z digest=sha256:e1921690990bfff2d06fd24818a60fb6e7487f0dec84f45d7e8b71f7c3a86738

Observation 4ad5eb4c-c7ef-4d94-84a1-5a68724abddb · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.928417Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.658376Z digest=sha256:1d32c1e001fe23f1291520b71f013f738e04d003ee1b7109ff2957c5a1c255af

Observation 4841b11d-3226-4ac2-a7af-274172aeb907 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.661380Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.661380Z digest=sha256:eb175e72fa7d8ddf3922c4d04f80c179784866c3eb163143d69210a315cc9d69

Observation 2a29e947-be23-4ff3-97b9-6a6a636a848c · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 28

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.918801Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.663939Z digest=sha256:f9d42efc860536ccb0ea042995ee915d8ec684140806c081dad9fda91340ceb7

Observation 82b774c8-8796-4faf-871a-36c6174e2adb · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 29

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.909943Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.666794Z digest=sha256:5ffcd8250a2487495534399b4d86a0d8133643648a20e2f828f22d269354c9ef

Pith citing papers

Observation 22c55187-dd1c-467d-8772-e84504bdcd3a · inbound

Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation cites this paper.

Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation The Roles of English in Evaluating Multilingual Language Models

Reference 101

Resolution
verified exact
local_arxiv, observed 2026-08-08T15:06:56.626299Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-08T15:06:55.213500Z digest=sha256:ccc1a50c0e9847b067c643f4a1051d28bc07f54a8fbc91a69f6809d2898a53f4