Paper Citation Record · LEDGER

MMLU-Pro+: Evaluating Higher-Order Reasoning and Shortcut Learning in LLMs

As of 16 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 11 inbound Pith citation observations for arXiv:2409.02257.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2409.02257 v3

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 11 of 11 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-16T06:30:59.297886+00:00

measured 11 of 11 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-16T11:30:12.036800Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-03T10:27:56.414590Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation fea2a709-2ef7-4aeb-acae-8bc9b0f13de9 · inbound

Evaluating the Robustness of Analogical Reasoning in Large Language Models cites this paper.

Evaluating the Robustness of Analogical Reasoning in Large Language Models MMLU-Pro+: Evaluating Higher-Order Reasoning and Shortcut Learning in LLMs

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-12T15:29:23.528914Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a7e173c9-b72b-4da4-b211-be0e042e9eb1 · inbound

DiffKV: Differentiated Memory Management for Large Language Models with Parallel KV Compaction cites this paper.

DiffKV: Differentiated Memory Management for Large Language Models with Parallel KV Compaction MMLU-Pro+: Evaluating Higher-Order Reasoning and Shortcut Learning in LLMs

Reference 64

Resolution: unresolved; no resolver link, observed 2026-08-11T22:51:12.228889Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c372a613-6459-48ba-b361-a19e82f48094 · inbound

Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation cites this paper.

Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation MMLU-Pro+: Evaluating Higher-Order Reasoning and Shortcut Learning in LLMs

Reference 85

Resolution: unresolved; no resolver link, observed 2026-08-11T22:37:56.318214Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1655239c-4031-40f4-a026-1ef5bfe7dc84 · inbound

Humanity's Last Exam cites this paper.

Humanity's Last Exam MMLU-Pro+: Evaluating Higher-Order Reasoning and Shortcut Learning in LLMs

Reference 52

Resolution: verified exact; arxiv_id, observed 2026-05-10T18:40:50.292773Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation e3dba890-2789-4a85-aa54-078c0035ca76 · inbound

Virology Capabilities Test (VCT): A Multimodal Virology Q&A Benchmark cites this paper.

Virology Capabilities Test (VCT): A Multimodal Virology Q&A Benchmark MMLU-Pro+: Evaluating Higher-Order Reasoning and Shortcut Learning in LLMs

Reference 68

Resolution: unresolved; no resolver link, observed 2026-08-16T11:30:12.036800Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f7a0cb8e-86be-4b03-ac03-4c9eb57a57ad · inbound

BenchHub: A Unified Benchmark Suite for Holistic and Customizable LLM Evaluation cites this paper.

BenchHub: A Unified Benchmark Suite for Holistic and Customizable LLM Evaluation MMLU-Pro+: Evaluating Higher-Order Reasoning and Shortcut Learning in LLMs

Reference 63

Resolution: unresolved; no resolver link, observed 2026-08-07T12:08:16.178310Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 017184d3-39eb-4eca-aa18-9bf6a83c9bcc · inbound

Beyond Statistical Learning: Exact Learning Is Essential for General Intelligence cites this paper.

Beyond Statistical Learning: Exact Learning Is Essential for General Intelligence MMLU-Pro+: Evaluating Higher-Order Reasoning and Shortcut Learning in LLMs

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-06T21:34:15.598649Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9717d2a1-315a-4ac1-b51d-f7940e0fb2e5 · inbound

Pretraining on the Test Set Is No Longer All You Need: A Debate-Driven Approach to QA Benchmarks cites this paper.

Pretraining on the Test Set Is No Longer All You Need: A Debate-Driven Approach to QA Benchmarks MMLU-Pro+: Evaluating Higher-Order Reasoning and Shortcut Learning in LLMs

Reference 63

Resolution: unresolved; no resolver link, observed 2026-08-06T14:44:09.424893Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 563518c4-1ddd-463c-b440-57685e23b800 · inbound

Towards Inclusive NLP: Assessing Compressed Multilingual Transformers across Diverse Language Benchmarks cites this paper.

Towards Inclusive NLP: Assessing Compressed Multilingual Transformers across Diverse Language Benchmarks MMLU-Pro+: Evaluating Higher-Order Reasoning and Shortcut Learning in LLMs

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-06T14:11:13.013412Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b946c5ab-c600-4479-b564-76e9885faa7d · inbound

FORT-Searcher: Synthesizing Shortcut-Resistant Search Tasks for Training Deep Search Agents cites this paper.

FORT-Searcher: Synthesizing Shortcut-Resistant Search Tasks for Training Deep Search Agents MMLU-Pro+: Evaluating Higher-Order Reasoning and Shortcut Learning in LLMs

Reference 65

Resolution: verified exact; arxiv_id, observed 2026-07-03T10:27:56.415938Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

Observation de5ad9f1-22a0-4a63-b019-4a7a6bcd612b · inbound

Bridging Compute- and Data-Optimal Pretraining cites this paper.

Bridging Compute- and Data-Optimal Pretraining MMLU-Pro+: Evaluating Higher-Order Reasoning and Shortcut Learning in LLMs

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-01T03:01:56.282390Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.