Pith. sign in

Paper Citation Record · LEDGER

Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

As of 5 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 19 inbound Pith citation observations for arXiv:2412.03304.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2412.03304 v2

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 19 of 19 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-05T06:32:48.257954+00:00

measured 19 of 19 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-03T00:24:08.131704Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T14:19:54.283579Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 5e020e07-84e8-46fd-ab00-b4d1c61bcd06 · inbound

Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities cites this paper.

Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

Reference 78

Resolution
verified exact
arxiv_id, observed 2026-05-19T05:52:07.901883Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=arxiv_source observed=2026-05-19T05:48:02.828938Z digest=sha256:d2c637f1e52fdf7239794a96114be9d92ecf0f6b44e6f5aacd903b650e876bf8

Observation f647a286-adac-4b2e-a8d2-d93469368f51 · inbound

Position: Stop Evaluating AI with Human Tests, Develop Principled, AI-specific Tests instead cites this paper.

Position: Stop Evaluating AI with Human Tests, Develop Principled, AI-specific Tests instead Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

Reference 70

Resolution
verified exact
arxiv_id, observed 2026-05-19T02:12:55.737216Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-19T02:12:48.586913Z digest=sha256:28685de2cb75594e89ee8f732aa4e3ab899bc7ee3d80fdf7ce5972be0cb03c18

Observation 6ba11cd8-df58-4c09-af34-fcc7c13e25af · inbound

Graph-Based Alternatives to LLMs for Human Simulation cites this paper.

Graph-Based Alternatives to LLMs for Human Simulation Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

Reference 68

Resolution
metadata mismatch
arxiv_id, observed 2026-05-18T00:50:33.234179Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=arxiv_source observed=2026-05-18T00:47:40.432039Z digest=sha256:4856eeb91daf0f387469c6a6bc2d6b4b1d695480cab6b16365c2634e70cb52dd

Observation 0ebbb4df-ea35-4e5c-b87b-66b8901b4c5c · inbound

NVIDIA Nemotron 3: Efficient and Open Intelligence cites this paper.

NVIDIA Nemotron 3: Efficient and Open Intelligence Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

Reference 143

Resolution
verified exact
arxiv_id, observed 2026-05-18T01:40:42.653286Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=arxiv_source observed=2026-05-18T01:40:42.190369Z digest=sha256:854213a23abce25426541cadec6b707ec98892c9b3bc80c299af473e5c9a47d7

Observation 9185ab9c-7987-4f7e-bc58-a4d9312e495b · inbound

When AI Benchmarks Plateau: A Systematic Study of Benchmark Saturation cites this paper.

When AI Benchmarks Plateau: A Systematic Study of Benchmark Saturation Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-02T22:31:50.017966Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T22:31:50.017966Z digest=sha256:2b432b4c83eb26b85438384e5ae10bd004709aa152d7e2eec5564d335a41c022

Observation f893290f-f430-4026-bc79-5fd4bde3f86c · inbound

MORPHOGEN: A Multilingual Benchmark for Evaluating Gender-Aware Morphological Generation cites this paper.

MORPHOGEN: A Multilingual Benchmark for Evaluating Gender-Aware Morphological Generation Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

Reference 34

Resolution
verified exact
arxiv_id, observed 2026-05-11T12:11:08.220134Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=arxiv_source observed=2026-05-10T04:04:12.610168Z digest=sha256:b68b1c3a9e2acc84df99a7291a79ca30431abd1ae60efda6544fb35f11845c11

Observation 8637deb7-4d4c-4ca6-ace2-6a6581d745d2 · inbound

COMPASS: COntinual Multilingual PEFT with Adaptive Semantic Sampling cites this paper.

COMPASS: COntinual Multilingual PEFT with Adaptive Semantic Sampling Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

Reference 63

Resolution
metadata mismatch
arxiv_id, observed 2026-05-11T13:41:05.490905Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=arxiv_source observed=2026-05-10T01:14:16.831333Z digest=sha256:c9fcefa42ffa2c5e6bb723d3fe5329f9b36e8b3bb6cd053e634283598d720fa8

Observation edad3d95-9560-4be5-8b82-db420c9c8fdc · inbound

STELLAR-E: a Synthetic, Tailored, End-to-end LLM Application Rigorous Evaluator cites this paper.

STELLAR-E: a Synthetic, Tailored, End-to-end LLM Application Rigorous Evaluator Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

Reference 28

Resolution
verified exact
arxiv_id, observed 2026-05-11T22:01:10.977384Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-05-08T03:39:30.528601Z digest=sha256:3902e2f23c9f7080bd04024de7a3d05aa3377b2d6fe1820b14fef1822f51d237

Observation 85cc8893-912a-4af4-a033-5d8ac039d995 · inbound

Cross-Lingual Consensus: Aligning Multilingual Cultural Knowledge via Multilingual Self-Consistency cites this paper.

Cross-Lingual Consensus: Aligning Multilingual Cultural Knowledge via Multilingual Self-Consistency Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

Reference 7

Resolution
verified exact
arxiv_id, observed 2026-05-22T06:36:10.018113Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=arxiv_source observed=2026-05-22T06:36:05.506175Z digest=sha256:0213fe5549a7b6415bf36d6822baa94c660e20914e89154e9440d94833529494

Observation 066f8156-3bc4-4da6-b54d-2a1cc7bf54aa · inbound

Cross-Lingual Consensus: Aligning Multilingual Cultural Knowledge via Multilingual Self-Consistency cites this paper.

Cross-Lingual Consensus: Aligning Multilingual Cultural Knowledge via Multilingual Self-Consistency Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

Reference 25

Resolution
metadata mismatch
arxiv_id, observed 2026-06-30T17:34:57.558733Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=arxiv_source observed=2026-06-30T17:31:39.958584Z digest=sha256:04dabb539775e07c7fc9320695b8e6f609dc4400751d1ef94fd720de8df80084

Observation aef667c6-d7f3-4a0f-8b1c-de52758e519c · inbound

Quantifying the Impact of Translation Errors on Multilingual LLM Evaluation cites this paper.

Quantifying the Impact of Translation Errors on Multilingual LLM Evaluation Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

Reference 6

Resolution
malformed identifier
arxiv_id, observed 2026-06-30T12:14:38.909100Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-06-30T12:14:02.815700Z digest=sha256:4cf6441ebf85ab1dd7fb7013b7dee074a913f8c5509d3103d401d85201e5b669

Observation b79a17a8-0469-4138-89d6-72b5a71f72d1 · inbound

Rethinking the Multilingual Reasoning Gap with Layer Swap cites this paper.

Rethinking the Multilingual Reasoning Gap with Layer Swap Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

Reference 5

Resolution
metadata mismatch
arxiv_id, observed 2026-06-29T18:03:48.213952Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-06-29T17:55:31.992163Z digest=sha256:fd943f5f44d6088c8526e32a6e63e8a3a34216396d6cd375af1b9d7d6f248753

Observation 3696b5ed-f64c-47c1-8591-79c84cc2a37c · inbound

Apertus LLM Family Expansion via Distillation and Quantization cites this paper.

Apertus LLM Family Expansion via Distillation and Quantization Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

Reference 17

Resolution
metadata mismatch
arxiv_id, observed 2026-06-29T13:33:28.256681Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-06-29T13:27:47.476242Z digest=sha256:e1d0eae912f77c07dfae0a7d1c8f95ce2ac8bc94b4c2f9f9c1b2ae61d89303b5

Observation 37a19daf-a62a-472e-8837-8c7fb4680344 · inbound

Shared Doubt: Zero-Shot Cross-Lingual Confidence Estimation for Language Models cites this paper.

Shared Doubt: Zero-Shot Cross-Lingual Confidence Estimation for Language Models Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

Reference 4

Resolution
metadata mismatch
arxiv_id, observed 2026-06-28T22:32:44.271789Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-06-28T22:28:20.824883Z digest=sha256:4a1d009644aa131ed3ea7506f3d4b750a527317a63e8ba022ca3c5de3dd3ba06

Observation 93af170c-01de-4c5b-9569-c75f654e2cdd · inbound

Multilingual Reasoning Cascades Need More Context cites this paper.

Multilingual Reasoning Cascades Need More Context Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

Reference 2

Resolution
metadata mismatch
arxiv_id, observed 2026-07-04T14:19:54.285370Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-06-26T04:07:08.848920Z digest=sha256:b19f5eef2f3af28fdbe35693dc144f235f8fff0a6a78b2e7f617b41d161e0767

Observation e1e79bb6-b0e0-4bfb-9df8-13fa83fd4424 · inbound

Auditing LLM-Governed Social Robots with Culture-Specific Moral Gradients cites this paper.

Auditing LLM-Governed Social Robots with Culture-Specific Moral Gradients Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

Reference 49

Resolution
verified exact
arxiv_id, observed 2026-06-30T11:14:37.476780Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

source=pdf_text observed=2026-06-30T11:13:36.521513Z digest=sha256:0bc4acce009c62008765cd93d3074a9ea87e2eff89b2a626ccca483515d140bf

Observation 40fb040e-78e9-4687-8003-0f6170f7b558 · inbound

In-Place Tokenizer Expansion for Pre-trained LLMs cites this paper.

In-Place Tokenizer Expansion for Pre-trained LLMs Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-01T23:50:17.232027Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T23:50:17.232027Z digest=sha256:1a71d9aaa726788fd2712cfd676456d90a18e147194d1f1336da53de753ec9e9

Observation 3db32d1b-02ce-49a8-ac76-0e61a02f0ad3 · inbound

Building a European Multilingual Evaluation Dataset: The MMLU Localisation Project within the EMT Network cites this paper.

Building a European Multilingual Evaluation Dataset: The MMLU Localisation Project within the EMT Network Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-01T15:28:19.272221Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T15:28:19.272221Z digest=sha256:af24302e689413c9310cfb4e0308622bcd338c23cc3703c93a611288ed955916

Observation 01abc87a-b506-4d56-a5c8-6699f866b788 · inbound

Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation cites this paper.

Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation

Reference 118

Resolution
unresolved
no resolver link, observed 2026-08-03T00:24:08.131704Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T00:24:08.131704Z digest=sha256:9b7711653ea439f663b041e12eb20a4019278a2d22fd8f9d6feefca05aed7888