Pith. sign in

Paper Citation Record · LEDGER

CodeMMLU: A Multi-Task Benchmark for Assessing Code Understanding & Reasoning Capabilities of CodeLLMs

As of 7 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 5 inbound Pith citation observations for arXiv:2410.01999.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2410.01999 v4

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 5 of 5 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 5 of 5 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T00:48:22.794752Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-15T18:51:30.579091Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation b70cf79a-33d9-4774-b9f8-b17d34044161 · inbound

A Comprehensive Survey of Deep Research: Systems, Methodologies, and Applications cites this paper.

A Comprehensive Survey of Deep Research: Systems, Methodologies, and Applications CodeMMLU: A Multi-Task Benchmark for Assessing Code Understanding & Reasoning Capabilities of CodeLLMs

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-07T00:48:22.794752Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T00:48:22.794752Z digest=sha256:4f2c53e175bc465a34e0da0ac85fbb9d3374f7946ec550d68d87ecd7c37d0544

Observation b5ba76ff-83e9-48af-9e76-e5f4482bc5d7 · inbound

FrontendBench: A Benchmark for Evaluating LLMs on Front-End Development via Automatic Evaluation cites this paper.

FrontendBench: A Benchmark for Evaluating LLMs on Front-End Development via Automatic Evaluation CodeMMLU: A Multi-Task Benchmark for Assessing Code Understanding & Reasoning Capabilities of CodeLLMs

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-07T00:40:25.739300Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T00:40:25.739300Z digest=sha256:41d420fe417408e308afd5b4a9a129621e687893f85a721d107d59c49ce30de9

Observation 7d96e3ce-65d6-42c3-b2b5-4317b13f1ae5 · inbound

Code Reasoning for Software Engineering Tasks: A Survey and A Call to Action cites this paper.

Code Reasoning for Software Engineering Tasks: A Survey and A Call to Action CodeMMLU: A Multi-Task Benchmark for Assessing Code Understanding & Reasoning Capabilities of CodeLLMs

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-07T00:29:33.032873Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T00:29:33.032873Z digest=sha256:603521f0799cbd6d2b7f3a59be76633bdc3b9a8e2dcff5ca2ce12f7cbe47dd78

Observation 1e6d9fb7-87f9-48d2-9c21-80d8a873314f · inbound

DiagramBank: A Large-scale Dataset of Diagram Design Exemplars with Paper Metadata for Retrieval-Augmented Generation cites this paper.

DiagramBank: A Large-scale Dataset of Diagram Design Exemplars with Paper Metadata for Retrieval-Augmented Generation CodeMMLU: A Multi-Task Benchmark for Assessing Code Understanding & Reasoning Capabilities of CodeLLMs

Reference 15

Resolution
verified exact
arxiv_id, observed 2026-05-15T18:51:30.584939Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-15T18:50:18.746038Z digest=sha256:b9dd6c558aa266f0613c338808cfccc728384a3b0c097f3511001d8e0947c6e8

Observation a6f3b54e-6ee5-4235-9c97-f1430fd54b33 · inbound

RepoReasoner: Evaluating Repository-Level Code Reasoning Ability of Long-Context Language Models cites this paper.

RepoReasoner: Evaluating Repository-Level Code Reasoning Ability of Long-Context Language Models CodeMMLU: A Multi-Task Benchmark for Assessing Code Understanding & Reasoning Capabilities of CodeLLMs

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-01T00:57:37.707760Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T00:57:37.707760Z digest=sha256:7e3247ed350ef805274b42b7aeb7c90abd8f40c15fb48ed9e90b0b4e36c2b585