Pith. sign in

Paper Citation Record · LEDGER

Evaluating Code Generation of LLMs in Advanced Computer Science Problems

As of 18 August 2026, this Paper Citation Record lists 17 of 17 outbound references and 0 inbound Pith citation observations for arXiv:2504.14964.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2504.14964 v1

Coverage vector

measured 17 of 17 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-16T11:39:19.442760Z

measured 17 of 17 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

17 of 17 outbound references displayed

  • verified exact1
  • verified fuzzy12
  • unresolved3
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 0248a5de-4a55-4081-af18-9353004a74e9 · outbound

This paper cites Analyzing LLM Usage in an Advanced Computing Class in India.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems Analyzing LLM Usage in an Advanced Computing Class in India

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-16T11:39:19.360109Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T11:39:19.360109Z digest=sha256:57fd9db7e2a52fcec53203e95c12bab0708afd1eef8ebdb789c185d062ae521d

Observation fca6071e-e565-4486-9cf3-f3420465b1e9 · outbound

This paper cites In: Proceedings of the 54th ACM Technical Symposium on Computer Science Education V.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems In: Proceedings of the 54th ACM Technical Symposium on Computer Science Education V

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.750790Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.366028Z digest=sha256:ce5189345de6aa12cc65a45f8c2896cb2f3033eac7125bbc34344a7d5263337a

Observation c998b83f-7138-484c-bbbd-27a0eae0d42d · outbound

This paper cites Evaluating Large Language Models Trained on Code.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems Evaluating Large Language Models Trained on Code

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-16T11:39:19.371007Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T11:39:19.371007Z digest=sha256:2c5fe5340c024177a5b18305496a3e4919f720f00b70386573eaae0495ec08d4

Observation cf67484f-14c8-45d1-9f3a-610f47fbba6b · outbound

This paper cites Insights from the Frontline: GenAI Utilization Among Software Engineering Students.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems Insights from the Frontline: GenAI Utilization Among Software Engineering Students

Reference 4

Resolution
metadata mismatch
local_arxiv, observed 2026-08-16T11:39:19.522116Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.375656Z digest=sha256:3d8281a1f272f2d57a10269f5bece4ccd70fb657a5de24dc489ba0d277d5cba1

Observation 8657252a-7c9a-4352-a479-30bcaedbfe36 · outbound

This paper cites "ChatGPT Is Here to Help, Not to Replace Anybody" -- An Evaluation of Students' Opinions On Integrating ChatGPT In CS Courses.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems "ChatGPT Is Here to Help, Not to Replace Anybody" -- An Evaluation of Students' Opinions On Integrating ChatGPT In CS Courses

Reference 5

Resolution
verified exact
local_arxiv, observed 2026-08-16T11:39:19.498427Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.380802Z digest=sha256:71891edb6c72e57069fe6e0d3d76ab341af925abfff2b754652859c1b5ef021a

Observation abbc0ec9-ae8d-496a-a09e-60af9b6176dd · outbound

This paper cites In: Proceedings of the 54th ACM Technical Symposium on Computer Science Education V.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems In: Proceedings of the 54th ACM Technical Symposium on Computer Science Education V

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.734915Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.386484Z digest=sha256:6cfd660433a95391fb49490608fcc6d435bfce4cacbce6dd66129ae1ae5e6671

Observation 9d45ec92-df5b-4a65-af97-edbf2d83ecf0 · outbound

This paper cites In: Proceedings of the 24th Australasian Computing Education Conference, pp.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems In: Proceedings of the 24th Australasian Computing Education Conference, pp

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.717872Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.391881Z digest=sha256:b0e5bd3d04b558276338b79d83f7b2f9b20242fcc42db19fa544a2c3e34f420c

Observation 881b85d0-6081-433d-8983-6706a799cde4 · outbound

This paper cites In: Proceedings of the 25th Australasian Computing Education Conference, pp.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems In: Proceedings of the 25th Australasian Computing Education Conference, pp

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.701967Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.396595Z digest=sha256:d6432e0b1a60294e7472055e051788cbe94090dfe62f43a349bd58e864ab98bc

Observation 5f8907a2-7534-42c1-ae19-f16d2fd123a8 · outbound

This paper cites Learning and individual differences103, 102274 (2023) 14 E.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems Learning and individual differences103, 102274 (2023) 14 E

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.686105Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.401573Z digest=sha256:c8ce36482d181a858761318e1ba3414108bb112823a9fbb88b15b6d369232dfb

Observation 9b020e71-60b3-4fa9-bfb2-5e9ecaaa550e · outbound

This paper cites In: Proceedings of the 24th Koli Calling International Conference on Computing Education Research, pp.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems In: Proceedings of the 24th Koli Calling International Conference on Computing Education Research, pp

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.670962Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.406413Z digest=sha256:7eff187299211d729cf07e1ec50d4aa62ed91e2869261e3be9095885cd2327ae

Observation 777583c8-7d8f-40f6-be34-76dd7e3f40a5 · outbound

This paper cites In: Proceedings of the 24th Koli Calling International Conference on Computing Education Research, pp.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems In: Proceedings of the 24th Koli Calling International Conference on Computing Education Research, pp

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.653636Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.411272Z digest=sha256:2ee05b5580391c4bf7af29f56132c6f51b8abf649bab67afb3db53c719713950

Observation 0a1e6179-2dc0-411e-aa4d-e2ac24d25966 · outbound

This paper cites In: Proceedings of the 2024 on Innovation and Technology in Com- puter Science Education V.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems In: Proceedings of the 2024 on Innovation and Technology in Com- puter Science Education V

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.637027Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.416568Z digest=sha256:16afa3d4c5961697b89642e19828632fbe3295840e32d3b7fa22339e4100c2c5

Observation 2d76802f-1ecf-4db4-9491-2cdb941717a9 · outbound

This paper cites In: Shaw, P.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems In: Shaw, P

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-16T11:39:19.421636Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T11:39:19.421636Z digest=sha256:24e68431f7601af0e8b8af201a3fd1b4f1fe9ba7336f145fec168bbd490fdfe5

Observation 92d9750e-54bd-46a5-8138-b02227a056fc · outbound

This paper cites In: Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems In: Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.620576Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.426821Z digest=sha256:2ddf7b7871a55ae051a10528769199414e12ad71c1411749c64bcdb1ebf92a88

Observation 01b777a8-231a-4c50-b1b6-11547dadcbaa · outbound

This paper cites Communications of the ACM29(9), 850–858 (1986).

Evaluating Code Generation of LLMs in Advanced Computer Science Problems Communications of the ACM29(9), 850–858 (1986)

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.604227Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.432798Z digest=sha256:d8fa7524081e2be9ee284cf7e00c48dede9145c4e03e843849180ed001011943

Observation c1364698-576d-4c73-8274-91ee0237080a · outbound

This paper cites 1 (2023) A Changed solutions We made some small alterations to the LLM-generated solutions before the tests.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems 1 (2023) A Changed solutions We made some small alterations to the LLM-generated solutions before the tests

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.588075Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.437859Z digest=sha256:2a776c5856eefc5d34d5611461be0e0f5b12f4e6690da920ea40b67589e6e26d

Observation ebdbd8ff-7a58-49ad-9f8f-3ea631d6b1b0 · outbound

This paper cites No changes were made to the algorithms of the solutions.

Evaluating Code Generation of LLMs in Advanced Computer Science Problems No changes were made to the algorithms of the solutions

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T11:39:19.571910Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-16T11:39:19.442760Z digest=sha256:7f58dfea5890b4c02597d4b890149772d36a145e4b58155bf47087860195ea5b

Pith citing papers

No inbound Pith citation observations are available.