Paper Citation Record · LEDGER

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

As of 5 August 2026, this Paper Citation Record lists 76 of 76 outbound references and 53 inbound Pith citation observations for arXiv:2305.01210.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2305.01210 v3

Coverage vector

measured 76 of 76 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-05-14T02:04:17.888553Z

measured 129 of 129 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-05T06:32:48.257954+00:00

measured 53 of 53 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-05T20:43:44.662023Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-05T02:28:24.338817Z

Reference resolution

76 of 76 outbound references displayed

verified exact14
verified fuzzy31
unresolved31
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

173
pith, observed 2026-08-05T02:28:24.338817Z

Outbound references

Observation f73be170-7431-4faa-88aa-b52f8eecb123 · outbound

This paper cites Ahmed and P.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Ahmed and P

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.249862Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 949efa0e-16cf-4f29-b64c-dedd88bdc79c · outbound

This paper cites SantaCoder: don't reach for the stars!.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation SantaCoder: don't reach for the stars!

Reference 2

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:17.938020Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 70d2ca6d-ab75-4ac0-9be2-d1ce9c2416c6 · outbound

This paper cites Austin, A.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Austin, A

Reference 3

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.286404Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation fac0f6ae-5cee-4951-8239-75706a60ae9e · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 4

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.289530Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 0688b73b-8ed6-4c6e-81fd-5e830ebde207 · outbound

This paper cites Black, L.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Black, L

Reference 5

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.293002Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 7f8acf35-d4fc-4f5e-9279-5d44ed6256c9 · outbound

This paper cites Brown, B.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Brown, B

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.300747Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 411e5b4e-02c1-4a32-b650-e4c0d593166c · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 7

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.304288Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 43dbb854-6b83-4772-8695-6313582d45d7 · outbound

This paper cites Cadar, D.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Cadar, D

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.307765Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation ea0550b9-7865-43a5-a0ee-027f55684d79 · outbound

This paper cites Cassano, J.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Cassano, J

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.311374Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 01893e90-e026-4c1f-b113-5d141122aa4e · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 10

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.314674Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 5f0de9db-4d67-41a8-ad68-edb9b52b77f3 · outbound

This paper cites Evaluating Large Language Models Trained on Code.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Evaluating Large Language Models Trained on Code

Reference 11

Resolution: verified exact; local_arxiv, observed 2026-05-14T02:04:17.959701Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 36f78d3c-1be9-46c8-a7f6-4e08ba570ced · outbound

This paper cites Chiang, Z.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Chiang, Z

Reference 12

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.327981Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation c5c7688c-859a-4e68-bd0f-83cb82f2e8f8 · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 13

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.331053Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 6bdc79ea-ee1a-4ff4-a742-b67b9cc0f4ae · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 14

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.335212Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 66279dc6-8d9f-4679-bc48-798242d23d7f · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 15

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.339909Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 4b45ab5c-057b-4993-a08d-37c75e5acccc · outbound

This paper cites Fauxpilot: an open-source alternative to github copilot server.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Fauxpilot: an open-source alternative to github copilot server

Reference 16

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.345772Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 29418d9f-fc37-4661-aef5-bccfcfe1939a · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 17

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.035645Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 8968cd5d-a183-49fc-b36d-d7db459f9be1 · outbound

This paper cites Fried, A.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Fried, A

Reference 18

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.041895Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 17cd2fbb-21c7-4c07-9348-11938d4ad6a0 · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 19

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.047446Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 2079d139-fe79-4d00-a935-0d345e139e9e · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 20

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.053673Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 8bf1ae76-8faf-42f3-93c1-65f71d1bbdc3 · outbound

This paper cites Gulwani, O.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Gulwani, O

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.063338Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation f77f2e7b-9911-4a06-a377-9c55202ed60a · outbound

This paper cites Hastie, R.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Hastie, R

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.070028Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 34ce07cf-2573-4151-be96-42a863889e1e · outbound

This paper cites Holler, K.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Holler, K

Reference 23

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.074605Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation a300eaed-3f09-4678-b30b-65804bf3c580 · outbound

This paper cites Ivankovi´c, G.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Ivankovi´c, G

Reference 24

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.079390Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 374ce154-fb10-42bb-b507-37bce2261277 · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 25

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.085043Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 4aa24f72-6b1a-445c-b36c-9ce893a23b34 · outbound

This paper cites Mistral 7B.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Mistral 7B

Reference 26

Resolution: verified exact; local_arxiv, observed 2026-05-14T02:04:18.001948Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 52af1a6e-2121-430d-a47c-0b8f3c53b5c5 · outbound

This paper cites Impact of Code Language Models on Automated Program Repair.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Impact of Code Language Models on Automated Program Repair

Reference 27

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:18.014273Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 7fa4371e-4c3f-46e5-a8dc-7876d2ecd440 · outbound

This paper cites SWE-bench: Can Language Models Resolve Real-World GitHub Issues?.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Reference 28

Resolution: verified exact; local_arxiv, observed 2026-05-14T02:04:18.022396Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation d50fb4ef-afc7-441a-b004-ef92a7df5e61 · outbound

This paper cites Kalyan, A.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Kalyan, A

Reference 29

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.090978Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation a3138b82-c67c-4e3a-8cf7-da1edda36ac4 · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 30

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.098983Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 4d310cd3-2c37-4d00-ad59-73124943232f · outbound

This paper cites Unsupervised Translation of Programming Languages.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unsupervised Translation of Programming Languages

Reference 31

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:17.993427Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation f2eb8f01-4c65-49f9-8673-f388a46ee0a1 · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 32

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.103730Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation abdb1ea0-c616-46ad-9db3-5c4ca40bf96e · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 33

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.111346Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation b63a7451-52dc-41e6-83b4-9eb99978cbc0 · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 34

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.119161Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation fa1da41f-c754-45e3-b78e-19fa62da4acd · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 35

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.122573Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 533ad619-2372-445d-9a43-8a88f4d15829 · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 36

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.126476Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 7a53ef94-3f67-47df-92ed-c82981612337 · outbound

This paper cites CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation

Reference 37

Resolution: verified exact; arxiv_id, observed 2026-05-15T11:40:02.914862Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation ead87ab5-6cef-4d53-b7bf-5df8003dabef · outbound

This paper cites WizardCoder: Empowering Code Large Language Models with Evol-Instruct.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation WizardCoder: Empowering Code Large Language Models with Evol-Instruct

Reference 38

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:17.985483Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation a455a752-73ee-4ac4-9d80-ce0a39234467 · outbound

This paper cites Manna and R.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Manna and R

Reference 39

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.133825Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 76fba8f1-d798-4456-b4db-f133d7123aae · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 40

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.137223Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation e80156be-262b-4f1b-a0d4-07973268d354 · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 41

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.140516Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 8ead5d23-3592-446d-b850-e9da13ab7789 · outbound

This paper cites GitHub Copilot – Your AI pair programmer.https://github.com/features/ copilot.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation GitHub Copilot – Your AI pair programmer.https://github.com/features/ copilot

Reference 42

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.148026Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation aedbf686-24cf-4ad2-8502-7294825cabc7 · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 43

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.152202Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation ef70036b-a4bf-4258-b343-424e609f5e13 · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 44

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.156502Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 8f23dfe8-7248-4f46-b55e-a2a9997199b8 · outbound

This paper cites Nijkamp, H.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Nijkamp, H

Reference 45

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.160859Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 4a8e6c2e-4908-4822-81ac-cf845dfebda4 · outbound

This paper cites Nijkamp, B.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Nijkamp, B

Reference 46

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.165155Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 67422d45-fd7e-47af-a57b-adc9fa271af0 · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 47

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.169828Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation e05f6857-6be3-4c99-aced-2f4ff5990bba · outbound

This paper cites Chatgpt: Optimizing language models for dialogue.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Chatgpt: Optimizing language models for dialogue

Reference 48

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.177498Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 58ebfbde-dbc7-4b54-a72b-44d0d3b610a5 · outbound

This paper cites GPT-4 Technical Report.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation GPT-4 Technical Report

Reference 49

Resolution: verified exact; local_arxiv, observed 2026-05-14T02:04:18.008192Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 040cdad9-9fc2-422a-9fd0-fd3612114024 · outbound

This paper cites Papineni, S.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Papineni, S

Reference 50

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.185652Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation ad4371e0-fe75-4b4e-9e25-bf9fcc182a95 · outbound

This paper cites Petrovi´c and M.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Petrovi´c and M

Reference 51

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.195769Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 54038b96-f9c8-4450-8fff-fd9f12c5d017 · outbound

This paper cites Phind/phind-codellama-34b-v2 · hugging face.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Phind/phind-codellama-34b-v2 · hugging face

Reference 52

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.201717Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 1d12a269-ae13-4c0c-ad3c-04cbe961407a · outbound

This paper cites Rothermel, M.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Rothermel, M

Reference 53

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.205944Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 1387f375-fb63-43f5-8064-f47684925b52 · outbound

This paper cites Code Llama: Open Foundation Models for Code.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Code Llama: Open Foundation Models for Code

Reference 54

Resolution: verified exact; local_arxiv, observed 2026-05-14T02:04:17.969215Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 5a2bcf3d-6b40-411b-8ea3-814661c43b0c · outbound

This paper cites Leveraging Automated Unit Tests for Unsupervised Code Translation.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Leveraging Automated Unit Tests for Unsupervised Code Translation

Reference 55

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:17.974075Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation f5d5f0c2-5bd9-4b0d-8fd5-d3ff6942ddd0 · outbound

This paper cites Security.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Security

Reference 56

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.210368Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation b62d1faa-3079-47d2-8881-6702e46e8d30 · outbound

This paper cites Serebryany.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Serebryany

Reference 57

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.215961Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 0cff1382-c898-490f-95a9-fff5ccdc35bd · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 58

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.220422Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 817e2ba6-0bba-4ea7-9805-21c1afc5832c · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 59

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.224667Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 5490c333-f08a-47f3-9cca-26a3264b47b5 · outbound

This paper cites Stablelm: Stability ai language models.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Stablelm: Stability ai language models

Reference 60

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.229138Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 63630815-ccf0-4f45-9534-cc7b27b0265c · outbound

This paper cites Vaswani, N.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Vaswani, N

Reference 61

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.233368Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation c1ebfdb5-bd0e-4dcf-af14-1cb47f90cca0 · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 62

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.237637Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation f37ade9c-ef78-4a70-aa7b-e39b36609806 · outbound

This paper cites Wang and A.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Wang and A

Reference 63

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.242502Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation c70a20bf-4ed4-4542-bb05-5808f9ce5db1 · outbound

This paper cites CodeT5+: Open Code Large Language Models for Code Understanding and Generation.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation CodeT5+: Open Code Large Language Models for Code Understanding and Generation

Reference 64

Resolution: verified exact; arxiv_id, observed 2026-05-19T05:26:57.653334Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 9a793f47-af67-4557-a227-e3b203b221aa · outbound

This paper cites Copiloting the Copilots: Fusing Large Language Models with Completion Engines for Automated Program Repair.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Copiloting the Copilots: Fusing Large Language Models with Completion Engines for Automated Program Repair

Reference 65

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:17.952242Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 784f48b6-3d7b-4b9a-b472-0205e3d903ec · outbound

This paper cites Winterer, C.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Winterer, C

Reference 66

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.246481Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 6a6e265a-f2af-44c1-aed0-82c85a5278ee · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 67

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.283210Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 27e9f268-6416-4047-bc48-15e164fd257a · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 68

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.252923Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation ea49175e-f8a9-46ab-8c8b-1023615d799a · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 69

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.258639Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 4bf61302-0235-4e49-8dcb-f6d2012d1ee9 · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 70

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.262350Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 50822c0d-70fe-4389-bb61-6356562a4a54 · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 71

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.265396Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 6ee73def-f8a7-4677-94b6-bebeee093b52 · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 72

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.268788Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation be4a29fd-3edd-442e-bc5a-dbe64d19da9d · outbound

This paper cites an unresolved cited work.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Unresolved cited work

Reference 73

Resolution: unresolved; raw_fallback, observed 2026-05-14T02:04:18.272073Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 79cac963-d3db-4feb-bd5f-bf1526b40968 · outbound

This paper cites Zalewski.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Zalewski

Reference 74

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.275719Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation a0df4eec-d2b2-43a5-baec-d2e5856d21a6 · outbound

This paper cites Zhang, D.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Zhang, D

Reference 75

Resolution: verified fuzzy; raw_fallback, observed 2026-05-14T02:04:18.279191Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation d065e01f-19e0-4044-a0f1-5b1be68a83b1 · outbound

This paper cites CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-X.

Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-X

Reference 76

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:18.031433Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Pith citing papers

Observation 40aaa769-da10-494f-a81a-6b6d410f0289 · inbound

CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society cites this paper.

CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 69

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 48975998-ef2f-4736-aa69-c3289948a757 · inbound

StarCoder: may the source be with you! cites this paper.

StarCoder: may the source be with you! Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 289

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation c1862457-8bd6-468d-9b75-9c5425455271 · inbound

Textbooks Are All You Need cites this paper.

Textbooks Are All You Need Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 20

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation eb0386ec-8d79-42f0-ac77-d3e6558a12d4 · inbound

A Survey of Hallucination in Large Foundation Models cites this paper.

A Survey of Hallucination in Large Foundation Models Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 81

Resolution: metadata mismatch; local_arxiv, observed 2026-05-16T15:21:00.858962Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 9d2f60b4-ba28-4982-946b-1f55c3023fda · inbound

SWE-bench: Can Language Models Resolve Real-World GitHub Issues? cites this paper.

SWE-bench: Can Language Models Resolve Real-World GitHub Issues? Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 113

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 5a6e1e36-c4e9-4760-a5ae-00f9de4c00e7 · inbound

LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code cites this paper.

LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 277

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 11e163e2-c1d4-4f87-ab0b-4667e551c619 · inbound

SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering cites this paper.

SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 26

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation fd5de2bb-c7be-4f87-bf34-5a3b69153488 · inbound

Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs cites this paper.

Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 31

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 6282e203-731d-4d3b-b0d2-f2945b65393e · inbound

Mercury: Ultra-Fast Language Models Based on Diffusion cites this paper.

Mercury: Ultra-Fast Language Models Based on Diffusion Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 28

Resolution: verified exact; local_arxiv, observed 2026-05-17T02:05:18.905965Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 2b7f693b-3821-4027-8715-437ead5f5ccc · inbound

NVIDIA Nemotron 3: Efficient and Open Intelligence cites this paper.

NVIDIA Nemotron 3: Efficient and Open Intelligence Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 104

Resolution: metadata mismatch; local_arxiv, observed 2026-05-18T01:40:42.541794Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 1084df84-7ec8-49a2-9561-8a9106c465bd · inbound

Ensemble-Based Uncertainty Estimation for Code Correctness Estimation cites this paper.

Ensemble-Based Uncertainty Estimation for Code Correctness Estimation Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 27

Resolution: verified exact; local_arxiv, observed 2026-05-14T22:53:14.056575Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 3b19f78c-15fc-4996-8f17-100d027cf72e · inbound

Leveraging Mathematical Reasoning of LLMs for Efficient GPU Thread Mapping cites this paper.

Leveraging Mathematical Reasoning of LLMs for Efficient GPU Thread Mapping Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 30

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 218a1ff0-f3c8-40de-a319-a1d625c43278 · inbound

Think Before You Code: Dual Reasoning for the NLSafety-Utility Trade-Off in LLM Code Generation cites this paper.

Think Before You Code: Dual Reasoning for the NLSafety-Utility Trade-Off in LLM Code Generation Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 19

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation a41a87fa-1cce-4152-b285-44bacb6a7aed · inbound

Think Before You Code: Dual Reasoning for the NLSafety-Utility Trade-Off in LLM Code Generation cites this paper.

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-03T00:19:57.865123Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a343b8f7-60d1-4bcd-bb72-1bbee37aa1fe · inbound

LLM-Based Multi-Agent Systems for Code Generation: A Multi-Vocal Literature Review cites this paper.

LLM-Based Multi-Agent Systems for Code Generation: A Multi-Vocal Literature Review Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 27

Resolution: verified exact; local_arxiv, observed 2026-05-15T19:56:33.755930Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 5cb5290e-be05-415e-b994-b43b142f8936 · inbound

Train Separately, Merge Together: Modular Post-Training with Mixture-of-Experts cites this paper.

Train Separately, Merge Together: Modular Post-Training with Mixture-of-Experts Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 26

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 3f084246-e86a-43b0-ab80-84f920b33324 · inbound

Co-Located Tests, Better AI Code: How Test Syntax Structure Affects Foundation Model Code Generation cites this paper.

Co-Located Tests, Better AI Code: How Test Syntax Structure Affects Foundation Model Code Generation Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 18

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 8d6e07d3-3929-444d-82fe-9ce2d533683b · inbound

You Don't Need Public Tests to Generate Correct Code cites this paper.

You Don't Need Public Tests to Generate Correct Code Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 14

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 5b0dd6e1-4b21-4614-ae54-72b8f8930637 · inbound

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis cites this paper.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 22

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation d8d67c4e-06f9-43ed-b96a-70a287891fd9 · inbound

When Prompt Under-Specification Improves Code Correctness: An Exploratory Study of Prompt Wording and Structure Effects on LLM-Based Code Generation cites this paper.

When Prompt Under-Specification Improves Code Correctness: An Exploratory Study of Prompt Wording and Structure Effects on LLM-Based Code Generation Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 23

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 4ec36916-308f-4f35-8a14-a51ea3e590a6 · inbound

ClassEval-Pro: A Cross-Domain Benchmark for Class-Level Code Generation cites this paper.

ClassEval-Pro: A Cross-Domain Benchmark for Class-Level Code Generation Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 25

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 32612799-a066-49b0-b250-2d8d92b0940e · inbound

ProgramBench: Can Language Models Rebuild Programs From Scratch? cites this paper.

ProgramBench: Can Language Models Rebuild Programs From Scratch? Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 10

Resolution: metadata mismatch; arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation e9240e43-6025-4883-aef6-1fe98f3715d6 · inbound

Bridging Generation and Training: A Systematic Review of Quality Issues in LLMs for Code cites this paper.

Bridging Generation and Training: A Systematic Review of Quality Issues in LLMs for Code Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 71

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 4423ff8d-f199-4bb1-bfff-6be961c09317 · inbound

SlimQwen: Exploring the Pruning and Distillation in Large MoE Model Pre-training cites this paper.

SlimQwen: Exploring the Pruning and Distillation in Large MoE Model Pre-training Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 44

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation d9bcabbb-4713-4817-b8ce-183363f209e4 · inbound

SlimQwen: Exploring the Pruning and Distillation in Large MoE Model Pre-training cites this paper.

SlimQwen: Exploring the Pruning and Distillation in Large MoE Model Pre-training Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 44

Resolution: verified exact; local_arxiv, observed 2026-05-20T23:23:51.285678Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 760705ac-573d-4fe2-baa0-39f883d84a80 · inbound

Using Semantic Distance to Estimate Uncertainty in LLM-Based Code Generation cites this paper.

Using Semantic Distance to Estimate Uncertainty in LLM-Based Code Generation Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 19

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 8aefd51a-7419-46f4-8b6e-86b02e2f5293 · inbound

Evaluating LLM-Generated Code: A Benchmark and Developer Study cites this paper.

Evaluating LLM-Generated Code: A Benchmark and Developer Study Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 9

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation cacf0642-5b7b-4c18-9d8d-cc6fc6eec3a1 · inbound

Evaluating LLM-Generated Code: A Benchmark and Developer Study cites this paper.

Evaluating LLM-Generated Code: A Benchmark and Developer Study Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 9

Resolution: verified exact; local_arxiv, observed 2026-07-01T13:35:46.788186Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 3cdb55f6-0bde-4d7e-b438-2ebdf4116c63 · inbound

DARE: Difficulty-Adaptive Reinforcement Learning with Co-Evolved Difficulty Estimation cites this paper.

DARE: Difficulty-Adaptive Reinforcement Learning with Co-Evolved Difficulty Estimation Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 31

Resolution: verified exact; arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation f62d2ac0-7294-439d-9d67-3408ef4d6fcc · inbound

Learning to Foresee: Unveiling the Unlocking Efficiency of On-Policy Distillation cites this paper.

Learning to Foresee: Unveiling the Unlocking Efficiency of On-Policy Distillation Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 14

Resolution: metadata mismatch; local_arxiv, observed 2026-05-22T10:11:22.819039Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation e5b40be9-fd56-473e-914c-dc4bdcfcb9ff · inbound

Solvita: Enhancing Large Language Models for Competitive Programming via Agentic Evolution cites this paper.

Solvita: Enhancing Large Language Models for Competitive Programming via Agentic Evolution Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 48

Resolution: verified exact; local_arxiv, observed 2026-05-19T16:32:39.498041Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation bcc93a67-bab7-4d9f-8068-85a5a2621b86 · inbound

Enhancing the Code Reasoning Capabilities of LLMs via Consistency-based Reinforcement Learning cites this paper.

Enhancing the Code Reasoning Capabilities of LLMs via Consistency-based Reinforcement Learning Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 24

Resolution: verified exact; local_arxiv, observed 2026-05-20T13:18:18.484837Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation c7bf2feb-010f-4fb2-927d-d630c7e32d9c · inbound

Hide to Guide: Learning via Semantic Masking cites this paper.

Hide to Guide: Learning via Semantic Masking Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 28

Resolution: verified exact; local_arxiv, observed 2026-06-30T12:24:40.021889Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 17f86524-7e07-495f-b44c-ccf06ace390b · inbound

Efficient Benchmarking Is Just Feature Selection and Multiple Regression cites this paper.

Efficient Benchmarking Is Just Feature Selection and Multiple Regression Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 51

Resolution: verified exact; local_arxiv, observed 2026-06-30T00:24:05.147871Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 25a591e1-839c-457b-8a2c-5f4f3c417a3f · inbound

Mellum2 Technical Report cites this paper.

Mellum2 Technical Report Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 45

Resolution: verified exact; local_arxiv, observed 2026-06-28T23:02:46.558336Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation fc6dd5e8-dcb0-4ed7-9f18-1d229776522b · inbound

Before the Model Learns the Bug:Fuzzing RLVR Verifiers cites this paper.

Before the Model Learns the Bug:Fuzzing RLVR Verifiers Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 4

Resolution: verified exact; local_arxiv, observed 2026-07-01T20:46:13.789220Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation c04cad1e-f21f-4203-b121-d643ecf823ce · inbound

What makes a harness a harness: necessary and sufficient conditions for an agent harness cites this paper.

What makes a harness a harness: necessary and sufficient conditions for an agent harness Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 24

Resolution: verified exact; local_arxiv, observed 2026-06-27T19:31:10.824991Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation ae850d5d-f139-45b7-b894-84f5dc478d58 · inbound

SFT Overtraining Predicts Rank Inversion via Entropy Collapse Under RLVR cites this paper.

SFT Overtraining Predicts Rank Inversion via Entropy Collapse Under RLVR Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 11

Resolution: metadata mismatch; local_arxiv, observed 2026-07-03T20:38:55.637534Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 4c48cefe-3cb8-4e0e-8d01-8ca8db22e6a3 · inbound

Reward-Free Code Alignment from Pretrained or Fine-Tuned LLM: Unpacking the Trade-offs for Code Generation cites this paper.

Reward-Free Code Alignment from Pretrained or Fine-Tuned LLM: Unpacking the Trade-offs for Code Generation Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 29

Resolution: verified exact; local_arxiv, observed 2026-06-30T08:34:26.739982Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 47b71b74-eb5f-4be1-8c74-7423ae7750d8 · inbound

An Empirical Study of Security Calibration in Large Language Models for Code cites this paper.

An Empirical Study of Security Calibration in Large Language Models for Code Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 41

Resolution: verified exact; local_arxiv, observed 2026-07-01T10:45:43.070608Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 10b6b78b-dee3-45c4-ad93-253eab5c4f9d · inbound

AlgoBench: Benchmarking Algorithmic Adaptation in Code Generation cites this paper.

AlgoBench: Benchmarking Algorithmic Adaptation in Code Generation Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 14

Resolution: metadata mismatch; local_arxiv, observed 2026-07-02T18:47:17.127993Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation c30963ce-27fa-400e-a435-fb9881c66479 · inbound

Oyster-II: Reinforcement Learning for Constructive Safety Alignment in Large Language Models cites this paper.

Oyster-II: Reinforcement Learning for Constructive Safety Alignment in Large Language Models Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 36

Resolution: unresolved; no resolver link, observed 2026-07-12T06:11:38.403281Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f4053761-1f3a-4636-b63e-1601cd84c74c · inbound

A Workflow-Aware Serving Layer for Agentic Applications cites this paper.

A Workflow-Aware Serving Layer for Agentic Applications Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 22

Resolution: unresolved; no resolver link, observed 2026-07-12T05:56:18.797766Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f66b06b5-0679-41c2-8d75-dc2f0fff2168 · inbound

Anchored Self-Play for Code Repair cites this paper.

Anchored Self-Play for Code Repair Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 18

Resolution: unresolved; no resolver link, observed 2026-07-12T01:53:44.674517Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 74094312-599d-401f-bb68-9e6b3453759b · inbound

From Execution to Education: A Bloom-Aligned Framework for Measuring Educational Control in LLMs cites this paper.

From Execution to Education: A Bloom-Aligned Framework for Measuring Educational Control in LLMs Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 101

Resolution: verified exact; local_arxiv, observed 2026-07-10T13:57:06.725523Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-05T06:32:48.257954+00:00.

Observation 5acf4e6d-2eaa-4133-858a-412334be0a1d · inbound

In-Place Tokenizer Expansion for Pre-trained LLMs cites this paper.

In-Place Tokenizer Expansion for Pre-trained LLMs Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-01T23:50:16.078214Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 352c5c68-993b-4673-8b6d-9112cf21ede2 · inbound

Half the Experts, All the Code: One-Shot Domain Pruning of Mixture-of-Experts LLMs for Coding cites this paper.

Half the Experts, All the Code: One-Shot Domain Pruning of Mixture-of-Experts LLMs for Coding Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-01T20:12:53.304097Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 72b1a9ee-8265-41f2-88a1-b21122b24e24 · inbound

FlowBlock: Wavefront-Parallel Decoding for Self-Correcting Diffusion Language Models cites this paper.

FlowBlock: Wavefront-Parallel Decoding for Self-Correcting Diffusion Language Models Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 2023

Resolution: unresolved; no resolver link, observed 2026-08-01T17:28:55.320455Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 95e456d9-3bab-4274-9bd1-b4de3c8cf946 · inbound

Rethinking Heterogeneous LLM Merging: A Weighted Model Averaging Perspective cites this paper.

Rethinking Heterogeneous LLM Merging: A Weighted Model Averaging Perspective Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-01T16:24:19.522774Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3c17ac66-529a-446f-9b63-b65ecb06dc92 · inbound

Do Modules Stay in Their Lane? Role Drift in Compound LLM Systems cites this paper.

Do Modules Stay in Their Lane? Role Drift in Compound LLM Systems Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 55

Resolution: unresolved; no resolver link, observed 2026-08-02T08:17:28.145819Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d5732c5c-1f04-4850-ae29-5c652702d708 · inbound

TLA+-Bench: An Execution-Grounded Benchmark and Dataset for Natural-Language to TLA Specification Generation cites this paper.

TLA+-Bench: An Execution-Grounded Benchmark and Dataset for Natural-Language to TLA Specification Generation Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 21

Resolution: unresolved; no resolver link, observed 2026-07-30T22:39:33.929232Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1cebe2c6-cf26-46bc-b2f4-b44bea188bbc · inbound

AtumAI: A Principled Framework for Agentic Generation of Datacenter Control-Plane Policies cites this paper.

AtumAI: A Principled Framework for Agentic Generation of Datacenter Control-Plane Policies Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-04T04:39:20.562448Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a0c3983b-7ae8-4e92-9d97-88c789f1249b · inbound

Route-Align-Verify for Functional Correctness in Code Generation cites this paper.

Route-Align-Verify for Functional Correctness in Code Generation Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-05T20:43:44.662023Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.