Pith. sign in

Paper Citation Record · LEDGER

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis

As of 4 August 2026, this Paper Citation Record lists 49 of 49 outbound references and 4 inbound Pith citation observations for arXiv:2604.24703.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2604.24703 v1

Coverage vector

measured 49 of 49 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-05-08T03:07:06.924437Z

measured 53 of 53 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-03T06:30:56.289259+00:00

measured 4 of 4 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-01T04:15:28.983324Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-07-02T01:16:24.932912Z

Reference resolution

49 of 49 outbound references displayed

  • verified exact18
  • verified fuzzy8
  • unresolved22
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation d57a7d5e-d135-4668-a9ef-060a4d4363bd · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.530253Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:8765047537b9e96f42a4e12677dee1c507598a5b7ae862768ed5185f8622c926

Observation e0b30893-280e-48c9-9026-ac2fbd32a4b6 · outbound

This paper cites Program Synthesis with Large Language Models.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Program Synthesis with Large Language Models

Reference 2

Resolution
verified exact
local_arxiv, observed 2026-05-11T22:16:35.651235Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:ace0c8a25bedcdb2e85766aa2ea1a33d6a67745a27502fe8a11bc9bc5c138942

Observation b696675f-ac02-41b7-9b36-6177e93f3596 · outbound

This paper cites Brown, Benjamin Mann, Nick Ryder, et al.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Brown, Benjamin Mann, Nick Ryder, et al

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T22:23:09.527108Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:e52b8925da703f7e12e54e1a9fbb631c75d47719e38c815af6f2319893697f5d

Observation 42cf42bf-571e-45c2-b83f-5de79cdaf9c8 · outbound

This paper cites NLPerturbator: Studying the Robustness of Code LLMs to Natural Language Variations.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis NLPerturbator: Studying the Robustness of Code LLMs to Natural Language Variations

Reference 4

Resolution
verified exact
doi, observed 2026-05-09T00:34:27.966157Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:f149b401565d209109bd77ba40b0fc030734df9525752c5e2c8a835cd2625d7c

Observation 84414a4b-9c18-4ab6-b048-eb00d2b8fb84 · outbound

This paper cites Evaluating Large Language Models Trained on Code.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Evaluating Large Language Models Trained on Code

Reference 6

Resolution
verified exact
local_arxiv, observed 2026-05-11T22:16:35.230445Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:708f6b5ec5bfb84c5835eadfb88e4846f77ca28f42df374ebc3230d51668a2b9

Observation 42b1a013-332e-4d29-964c-cc408d008fe6 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.533221Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:1ae353cdd8ad9c6f745d847415954778cebabe284ddb86a08663973635b98b49

Observation 20307a8f-6bb5-49d1-8bd6-db9e5c29132e · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.518717Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:88c81aad31b054dc267d3868f1e965352ae3c148e9756077a534c68aabf500c9

Observation ab3c4f7a-d59b-4b85-96b6-f0fca7c84579 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.513429Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:97e110ca37143183c532e1c499493eac3f8025bb99618ea362d23c8455805cd7

Observation c328605b-fb4f-4ef5-8254-7beb444bfca7 · outbound

This paper cites DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence

Reference 10

Resolution
verified exact
local_arxiv, observed 2026-05-11T22:16:35.855445Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:6326a43f929a50a39d9f7aafeb26a4db029e37af3b4508e6721b40054b10d75f

Observation be1b776d-5eec-4ea0-964d-c2bd95049e0c · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 11

Resolution
verified exact
arxiv_id, observed 2026-05-09T00:34:27.971119Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:075ed8e52f3d763ecd9cbcce3760c788a83242c5de447deaf7918b2baa184a99

Observation 7cc92354-e4c2-41ce-b867-4ccd70de6dc0 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.510182Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:bdf5fe6082eac86d8b654c89c808f8c9430216d71bcef022112ae21b0654978c

Observation 7261f562-6e3f-438f-a8e4-513752bc1aed · outbound

This paper cites Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, et al.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, et al

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T22:23:09.522324Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:5800062d63359869eb820bcc59cbc89f96488e85542fd1954e2e1503c2eda757

Observation 3a40d39f-1cf4-47c6-87f8-71d0b0227163 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.537577Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:5295156b79eac7c66ded13097244111af989d45c891593395987ce2ed8b12e66

Observation 0009d40a-5784-48be-9ff4-6a6a88af15e8 · outbound

This paper cites Qwen2.5-Coder Technical Report.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Qwen2.5-Coder Technical Report

Reference 15

Resolution
verified exact
local_arxiv, observed 2026-05-11T22:16:34.550339Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:237ee2e6f64540aa2ae7f3a1f71153fb630f6fa579d28be0d3694fc16929d2c7

Observation 65aecbdb-2bec-4692-a153-2338d8a450dd · outbound

This paper cites LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code

Reference 16

Resolution
verified exact
local_arxiv, observed 2026-05-11T22:16:34.990352Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:8c8cb4c9339731e28f7fde31403bfe089160fea521f66609733367ce2f9e3c0b

Observation 4b425951-e5eb-4829-89d9-5eb336dd5075 · outbound

This paper cites Automated repair of ambiguous problem descriptions for llm-based code generation,.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Automated repair of ambiguous problem descriptions for llm-based code generation,

Reference 17

Resolution
verified exact
arxiv_id, observed 2026-05-11T22:16:32.529961Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:1991db2a2539b665cdc9755b59b2d8bc93f2c04210fbd8b18dc78965c2c10341

Observation 66fb0c0f-cf7f-42ba-a0b8-861052a40c34 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.545575Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:29e9b19e645b0c6f62dba14882359215f6754e6695c2d07eeea46ede56b07f3b

Observation 198ab81f-943e-426d-98b9-64b4c293c359 · outbound

This paper cites When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis When Prompts Go Wrong: Evaluating Code Model Robustness to Ambiguous, Contradictory, and Incomplete Task Descriptions

Reference 19

Resolution
verified exact
arxiv_id, observed 2026-05-11T22:16:34.336735Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:ae8d1d8ce7e590fe0009fab291ca13928ba41e7d63c6e156a58691c4c4be5d67

Observation a0656451-8f1e-4808-a23f-a201698ae773 · outbound

This paper cites ACM Trans.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis ACM Trans

Reference 20

Resolution
verified exact
doi, observed 2026-05-09T00:34:27.979900Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:998c0ed699770eb7de336c99e0ee65c6dd8ba16861dd0e1edd0ff8fa0a04dd5e

Observation e9cec5d3-0fe5-404e-a0cc-48f4156b5110 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.505980Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:439fd17b4b3f614db28841a316204b4106c322591490f899fe93154cb331327e

Observation 5b0dd6e1-4b21-4614-ae54-72b8f8930637 · outbound

This paper cites Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation

Reference 22

Resolution
verified exact
arxiv_id, observed 2026-05-14T02:04:18.346890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:16def9afc2244993b828d5a27548d66144e1ae49385ca2b386a0f7c86930c005

Observation 4476c9c4-e3e1-4fba-b503-42db211b6fe2 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.493361Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:5a704a70f26f70ab0f893a5c6a86f7a3e4f9304dda5eb9daee8c77d73e2d6244

Observation 6c74e30e-2bff-4618-87c9-0cf917b7ce7e · outbound

This paper cites StarCoder 2 and The Stack v2: The Next Generation.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis StarCoder 2 and The Stack v2: The Next Generation

Reference 24

Resolution
verified exact
arxiv_id, observed 2026-05-12T17:28:23.399599Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:ddf8cdbe4b828bc9152163135e3f92ec2f110a60c24c88bbba78f59506fcfae9

Observation 503e258d-1bf7-48cf-8718-f70a3e1676c5 · outbound

This paper cites Lahiri, and Sid- dhartha Sen.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Lahiri, and Sid- dhartha Sen

Reference 25

Resolution
metadata mismatch
arxiv_id, observed 2026-05-09T00:34:27.976541Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:c073baa09403c679f30a1cb47bc0e4fef814aa3a31850daed75726c128dd9d67

Observation e728304b-51cc-429b-bdd1-070e2a3570ca · outbound

This paper cites Matthews.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Matthews

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T22:23:09.496475Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:5327386cb9b00cc7a7e5599b91433c679546b5bc5e03c7673bb2a7efb4d9bf07

Observation 6afee0b5-40d8-41c6-9dce-d781471431d7 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.501881Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:81fcdd9519c8826d8bf775efa3a34a861f20820f9147e79e73f11651db1be85f

Observation 326edbdb-762f-4a6e-8b74-d3d9496f9991 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 28

Resolution
verified exact
arxiv_id, observed 2026-05-09T00:34:27.962680Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:c3d0724c57f179580e21bc421586e6ac5ce94a3f434b97c21d46885b227ae7c6

Observation 2ca8e452-baff-49e3-b456-99fc1ad6ac41 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 29

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.541572Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:2895bc0e6c240133698eca2bf058542907f1ea9ab9e6704e018a5b4dca88e78e

Observation 0f557631-d571-4694-a884-026e19692152 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 30

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.550295Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:d97b68e3398b4f07385f56624ae87b90a724200a332b9eb36b065f3382bcfb0b

Observation 46d4a249-821d-4cdc-bbe3-a369abb73a29 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 31

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.490884Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:814b8d1c0cde571812e4b6f7ac30339cebedc7706c2af362f3690485b29b59f4

Observation 85cc2cc0-445a-4df5-8f35-0721e10a55c6 · outbound

This paper cites The Impact of AI on Developer Productivity: Evidence from GitHub Copilot.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis The Impact of AI on Developer Productivity: Evidence from GitHub Copilot

Reference 32

Resolution
verified exact
local_arxiv, observed 2026-05-11T22:16:36.005374Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:281aeab2d29297e8122308789679df7b60a6322a16f51b190d392645dc9619e0

Observation 44537e20-4a6e-41c9-bd61-76205c3df51e · outbound

This paper cites A Multi-Language Perspective on the Robustness of LLM Code Generation.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis A Multi-Language Perspective on the Robustness of LLM Code Generation

Reference 33

Resolution
verified exact
local_arxiv, observed 2026-05-11T22:16:33.668355Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:2c54b95772997cdfac73ddb239cd71dc5185b3312f1660e2c0d4a80c15307ca0

Observation 10a62b5d-9430-4198-b65e-b26be492ed74 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 34

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.485441Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:543747b2a58d2b4957fdd706ecedaa644e58c8d049e36cb0bb02b96db4847e38

Observation 7f45209d-3fad-40bf-8d73-e10eb8121799 · outbound

This paper cites Code Llama: Open Foundation Models for Code.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Code Llama: Open Foundation Models for Code

Reference 35

Resolution
verified exact
local_arxiv, observed 2026-05-11T22:16:33.998909Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:fe6575c32840e3e6eef91a1a03a83bbd929468b7606d7cdafde1bf876795f058

Observation 26f0669a-751e-4a8f-a723-43a3915635be · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 36

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.482738Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:717210b3b313da56f23b15934d24f10880009e457ac68c2b444f4f3157838feb

Observation e38fa3c6-2e91-4234-a290-78512fc7b7aa · outbound

This paper cites Exploring the Robustness of Large Language Models for Solving Programming Problems.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Exploring the Robustness of Large Language Models for Solving Programming Problems

Reference 37

Resolution
verified exact
arxiv_id, observed 2026-05-11T22:16:33.396088Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:7785d0a02fb559a016a0f2ad28225948d648de918a76d48bab64f3a2a90d7faf

Observation 11427511-b106-46e1-bec2-d3c268d1d422 · outbound

This paper cites Saha, and Joanna Santos.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Saha, and Joanna Santos

Reference 38

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T22:23:09.488324Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:543d2c5e5ad1ca302a765f9e7f765f5640487f5f7b2b0baf64b9319b0fe3c765

Observation 6c6dc3b7-39a5-48c2-aab2-b0f3e38525b0 · outbound

This paper cites InProceedings of the IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM).

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis InProceedings of the IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM)

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T22:23:09.475044Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:ad5cae8054e32061899ff1d5530be417747a7b8e31561d2eb3c9045795796a8f

Observation b9d71154-5bf7-483f-94ee-a84647211ac8 · outbound

This paper cites 2025.µFiX: Fixing Large Language Models’ Specification Misunderstanding for Better Code Generation.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis 2025.µFiX: Fixing Large Language Models’ Specification Misunderstanding for Better Code Generation

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T22:23:09.477898Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:108e86b594e874f56374e834b4f8fb0b5dabc164920b904edf8cc803629103c9

Observation 7dab856a-19c1-45be-a5da-47077a6d3d32 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 41

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.472310Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:03011e5c7d63504cc9691d4924cb3c8fed86d473b2e255cf8bc13b3068c720e5

Observation 113b63b1-d8c1-45e4-9ebc-351389202833 · outbound

This paper cites 2009.Requirements Engineering - From System Goals to UML Models to Software Specifications.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis 2009.Requirements Engineering - From System Goals to UML Models to Software Specifications

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T22:23:09.469682Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:1230770e862c2c022ce2469bab2b581fc56c33711308341da822815d59e687ac

Observation b2484cae-d64e-44ae-8506-9b40efcf1116 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 43

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.480221Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:b5ea9b98042514aa2a1b933b245d1795927bf147688b729f0cae031ccb92a52b

Observation e45089ff-6489-4862-b69c-a0eee99fbc38 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 44

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.455930Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:b8da7abc411ca3fecf52e341e18d65980684d57ed300be215d24a5317931c0f3

Observation c489368c-7c85-4915-a984-4e0680f3a25d · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 45

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.453203Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:293718e1e90b3c805255b16ec2b89644e4dee8012ad3a331f47373703d4c0061

Observation 27a8b123-b7be-4e3d-a7c2-a565f9847580 · outbound

This paper cites Wu and Fatemeh H.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Wu and Fatemeh H

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T22:23:09.458515Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:3c49798aa6badefd03496fa5e4affdf7ddfece5f735c9fb165f61e2e38370715

Observation e46563de-befa-46c9-b95f-df37e175a67a · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 47

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.461150Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:3eef95426b5dc7fe80ca9f8c0c66ea3936594632b48904bb3f8223e9c5381924

Observation 715c9d2f-c098-40c5-bffe-bc5d1fdd6210 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 48

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.466614Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:6afe1136cfa3c987949fa713ca5320c04764cf2dc88cab7ce4b02356b75e2cba

Observation 917050a2-db85-48c7-981d-eee6e8853573 · outbound

This paper cites an unresolved cited work.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis Unresolved cited work

Reference 49

Resolution
unresolved
raw_fallback, observed 2026-05-26T22:23:09.463715Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:8f2cc84bbea0e80a6b6a3fbdfc98b4e334cabd5821969917f0f5ef621ff77534

Observation 3de16972-e9f0-4db8-9a77-aaa53304d2d7 · outbound

This paper cites BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions.

Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

Reference 50

Resolution
verified exact
arxiv_id, observed 2026-05-14T19:30:10.582609Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T03:07:06.924437Z digest=sha256:98f75fbe86b941b1386f6d528bdcbbeb80b72a556c5006f681cfa4edab79c665

Pith citing papers

Observation 600e7d5d-35b3-4ccc-aff0-3135ad555c0f · inbound

Agent System Operations: Categorization, Challenges, and Future Directions cites this paper.

Agent System Operations: Categorization, Challenges, and Future Directions Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis

Reference 93

Resolution
verified exact
local_arxiv, observed 2026-07-02T01:16:24.934327Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-06-28T12:14:21.322860Z digest=sha256:871253ce9ea65ad15816432158a2c916970990d3daed47b52d9b4a0f7cae0180

Observation 02a9404e-2b81-41fd-b3e3-eb45f64ef39d · inbound

From Failing to Passing: Evolving Natural Language Prompt Optimization Rules for LLM Code Generation cites this paper.

From Failing to Passing: Evolving Natural Language Prompt Optimization Rules for LLM Code Generation Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis

Reference 2

Resolution
unresolved
no resolver link, observed 2026-07-11T08:31:24.850506Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-11T08:31:24.850506Z digest=sha256:64e489823375cde4616e0b2b788bf8cf79b58a22d484bd74e4f2c05d10637ecd

Observation 186ee387-bd30-4bca-997c-cf59a64bda0f · inbound

On the risk of coding before testing: An empirical study on LLM-based test generation workflow cites this paper.

On the risk of coding before testing: An empirical study on LLM-based test generation workflow Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis

Reference 52

Resolution
unresolved
no resolver link, observed 2026-07-11T08:12:23.512737Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-11T08:12:23.512737Z digest=sha256:522e98c3330e24983c8896a107082e1b4a445f16c67aac13d2d3597d654cb7dc

Observation 380c359b-0dcc-40b1-aa4f-1c65b788884a · inbound

AssumptionMiner: Extracting, Tracing, and Revising Implicit Assumptions in LLM Code Generation cites this paper.

AssumptionMiner: Extracting, Tracing, and Revising Implicit Assumptions in LLM Code Generation Defective Task Descriptions in LLM-Based Code Generation: Detection and Analysis

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-01T04:15:28.983324Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T04:15:28.983324Z digest=sha256:b31e0e6045ce7ac1f395cedd866914bbca923f137f91c3ad491c45039dec2735