Pith. sign in

Paper Citation Record · LEDGER

CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generation

As of 8 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 7 inbound Pith citation observations for arXiv:2311.08588.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2311.08588 v3

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 7 of 7 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 7 of 7 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-08T16:26:32.490664Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-05T07:20:46.372334Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation c2134f09-5dd9-4c50-b275-35602ee30fda · inbound

LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code cites this paper.

LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generation

Reference 238

Resolution
verified exact
arxiv_id, observed 2026-05-10T17:34:42.853047Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-05-10T17:34:42.565806Z digest=sha256:fac0f6796576ae81a5f17c402f1883b03c272f379a1715ed93d090539cc1ddbe

Observation 56e83b94-0564-4b27-b952-9d5fe4cb0447 · inbound

LessLeak-Bench: A First Investigation of Data Leakage in LLMs Across 83 Software Engineering Benchmarks cites this paper.

LessLeak-Bench: A First Investigation of Data Leakage in LLMs Across 83 Software Engineering Benchmarks CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generation

Reference 98

Resolution
unresolved
no resolver link, observed 2026-08-08T16:26:32.490664Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T16:26:32.490664Z digest=sha256:06bcc8390dbc5e67a8893c719659ea82cafea9f39f7be1480434688c21574607

Observation c4398e9e-b76f-4cea-9e54-431709172ac7 · inbound

Copilot Arena: A Platform for Code LLM Evaluation in the Wild cites this paper.

Copilot Arena: A Platform for Code LLM Evaluation in the Wild CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generation

Reference 44

Resolution
unresolved
no resolver link, observed 2026-08-07T21:56:20.389296Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T21:56:20.389296Z digest=sha256:9e416c91bf662ba405a378f699bb23325f4298abfbd3c1f6eb01a54c703c2ffe

Observation 387874fd-dadb-4a15-a80f-cbe209318693 · inbound

GeoPandas-AI: A Smart Class Bringing LLM as Stateful AI Code Assistant cites this paper.

GeoPandas-AI: A Smart Class Bringing LLM as Stateful AI Code Assistant CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generation

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-07T04:06:55.093762Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:06:55.093762Z digest=sha256:2e2ffa0a6d1dc5338a62943c5007b6be0d4dfb3360493fdac88a4c186f4fdf12

Observation b1bad932-059c-4e2f-b8c6-195c5ce74a05 · inbound

CityRAG: Stepping Into a City via Spatially-Grounded Video Generation cites this paper.

CityRAG: Stepping Into a City via Spatially-Grounded Video Generation CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generation

Reference 73

Resolution
verified exact
arxiv_id, observed 2026-07-05T07:20:46.374253Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-07-05T07:19:01.989427Z digest=sha256:e7bee8976801b3c2b6225182cfffcd5ddd68d6c70587638f5141dbc671a74f77

Observation efe3fe64-5571-426f-9754-566f0c48c6e6 · inbound

PlayCoder: Making LLM-Generated GUI Code Playable cites this paper.

PlayCoder: Making LLM-Generated GUI Code Playable CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generation

Reference 73

Resolution
verified exact
arxiv_id, observed 2026-05-11T13:16:17.745837Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-10T02:02:01.395176Z digest=sha256:769b86157f987a3e45cde8bee82c1c9866f1fb4c172ec7aa768b7b9537c622a8

Observation 7e08dd28-ac46-4e4d-8bc4-373d798c2c87 · inbound

Characterizing initial human-AI proof formalization workflows cites this paper.

Characterizing initial human-AI proof formalization workflows CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generation

Reference 45

Resolution
verified exact
arxiv_id, observed 2026-07-02T04:06:34.836702Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-06-28T09:29:50.282874Z digest=sha256:7b4105362fa94243330c56d7fdafa0f9edfd06354f276f5065b90a14825cf3e0