Pith. sign in

Paper Citation Record · LEDGER

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems

As of 18 August 2026, this Paper Citation Record lists 30 of 30 outbound references and 1 inbound Pith citation observation for arXiv:2508.03931.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2508.03931 v1

Coverage vector

measured 30 of 30 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T01:07:40.389625Z

measured 31 of 31 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-17T06:30:58.91139+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-06-27T00:13:28.707612Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

30 of 30 outbound references displayed

  • verified exact0
  • verified fuzzy25
  • unresolved5
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

0
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

Observation 00743ab9-597e-4aef-be7e-b012b5301004 · outbound

This paper cites Learning to represent edits.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Learning to represent edits

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:45.725448Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:37.765614Z digest=sha256:71a9539d73f64806d3beb9aafbdf763226474081fb550cacf96108327e76b48b

Observation e8476e4a-dc6e-4108-b58b-91de64731a22 · outbound

This paper cites Recode: Benchmarking language models for code repair and generation.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Recode: Benchmarking language models for code repair and generation

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:45.542379Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:37.826445Z digest=sha256:02b193630494c226f34db44efb07b7671b3cbe75df999d9bb6cb39eb726810a5

Observation c98b8282-5169-407c-9b30-c3933057bd1b · outbound

This paper cites B., AND POLIKARPOVA , N.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems B., AND POLIKARPOVA , N

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:45.371841Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:37.915003Z digest=sha256:bfe5419b9f4d2b54274c41655228dddf876847cdf0f14ca16a365b5f9f403a4f

Observation 616a26a5-ed52-4cdd-91c2-8d054aa32b02 · outbound

This paper cites M., G EBRU , T., M CMILLAN -MAJOR , A., AND SHMITCHELL , S.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems M., G EBRU , T., M CMILLAN -MAJOR , A., AND SHMITCHELL , S

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:45.152146Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:37.978887Z digest=sha256:e3f26ea0d3df30cf00a4e96d28a2ec5b9c27399b072e44da14540948f5b98c40

Observation d2b95be4-2e0b-44f2-88b6-bbc8c272cbae · outbound

This paper cites Supersonic: Learning to generate source code optimizations in c/c++.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Supersonic: Learning to generate source code optimizations in c/c++

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:44.948298Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:38.081299Z digest=sha256:557ea219f55182cb88fd48f48011ee290b4b79fdd3cac8e8bd433067658b0344

Observation d12a5467-900b-46e0-bd6f-ee60f1a6da74 · outbound

This paper cites Codereval: A benchmark for evaluating code generation models, 2022.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Codereval: A benchmark for evaluating code generation models, 2022

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:44.761972Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:38.157209Z digest=sha256:5eea07762fc697df608774363020a25da98d39dafe7736506d434bdbd49e1649

Observation ab303350-cddd-43c4-a448-b4298882c11e · outbound

This paper cites A performance study of llm-generated code on leetcode.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems A performance study of llm-generated code on leetcode

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:44.632009Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:38.220636Z digest=sha256:9280d2503c035c507d6df037f42c2c94b9c1272bc31bba3a128473fff321d614

Observation 494f5109-342e-4705-9664-40374b18ebe4 · outbound

This paper cites E., AND COMBE - MALE , B.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems E., AND COMBE - MALE , B

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:44.486414Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:38.305622Z digest=sha256:2db31789ddb6e935be3654786dd7e2277e0cf37a32c721ffdde0cf0c849f88a2

Observation 26ce8f52-4d4c-4af4-8245-6375461c1cc6 · outbound

This paper cites an unresolved cited work.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-08-06T01:07:44.307227Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:38.404282Z digest=sha256:5e6865ba432a9868a9fb8368687e2577959b2171164bafdfad6cb8e1dbc9e37d

Observation 742f2b8c-4c87-4f1a-ada9-bfdb1e775057 · outbound

This paper cites Evaluating large language models trained on code, 2021.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Evaluating large language models trained on code, 2021

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:44.134215Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:38.485056Z digest=sha256:095ceae9ae247f1700d7d2eec74701089f5cf9d2e29c06ff0c151dd98d0be5cc

Observation d7d986d6-4eb4-4f33-8bff-405f90d77f8b · outbound

This paper cites Codebert: A pre-trained model for programming and natural languages.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Codebert: A pre-trained model for programming and natural languages

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:43.998206Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:38.560465Z digest=sha256:4f01f2c6d06505a913ff13055685333ffb8561d58d230528df18f77ee67e6573

Observation 2819c5af-fb66-4789-bff1-5f46e84f4cb1 · outbound

This paper cites Z., C LEMENT , C.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Z., C LEMENT , C

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:43.827188Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:38.668841Z digest=sha256:7e7d2d203077223ab1fea5c278bac40ef3a1990f41a9873bb211200bcf6ff609

Observation 383971be-ca75-4ec6-bc5a-520775ed125d · outbound

This paper cites T., AND MORGAN , E.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems T., AND MORGAN , E

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:43.671126Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:38.769303Z digest=sha256:203f37fe4508fea04deddd0f3332bbb89f40a032b543a5885d61ee715964d65d

Observation e6a3de81-b89f-4536-befe-4c877070e263 · outbound

This paper cites Beyond code generation: An observational study of chatgpt usage in software engineering practice.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Beyond code generation: An observational study of chatgpt usage in software engineering practice

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:43.514703Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:38.857750Z digest=sha256:5330fcf8b20ac398f3d2ffaff39096c421420c6e7a8effe8393fafad42f53078

Observation 8779f534-bf4b-4401-a9ac-1e37225db3d2 · outbound

This paper cites Leetcode: The world’s leading online programming learn- ing platform.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Leetcode: The world’s leading online programming learn- ing platform

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:43.342901Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:38.948786Z digest=sha256:5f8c85b881642c6c5938dc2dfe1f5fc0b655540208f485ee31e94cd693e1b780

Observation 9141ac25-bcd1-4f7f-8eaa-000ec524f2e2 · outbound

This paper cites S., W ANG , Y., AND ZHANG , L.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems S., W ANG , Y., AND ZHANG , L

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:43.196160Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:39.051830Z digest=sha256:43b04abbca63ff6f4e4203becc36273e4c66906d8b19955696f009b061a43f09

Observation 4be7029a-896c-4948-881c-7f5c7fc89252 · outbound

This paper cites Ai software reliability: Concepts and related domains.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Ai software reliability: Concepts and related domains

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:42.915820Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:39.124147Z digest=sha256:44edee3aba87608755c07b69f235304f150877b733f5fc765f8ba75e865f16b3

Observation f4980b23-e637-451b-a705-405212e85dca · outbound

This paper cites B., D RAIN , D., B ING , L., Z HOU , M., AND SUNDARE - SAN , N.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems B., D RAIN , D., B ING , L., Z HOU , M., AND SUNDARE - SAN , N

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:42.638507Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:39.225187Z digest=sha256:4051f3408f113cfc51e719d9300effc709211fdb3aaf12e830ba523492312bf3

Observation d04c6f3e-5186-492c-b39b-d0d22d0aee1e · outbound

This paper cites Artificial in- telligence versus software engineers: An evidence-based assessment focusing on non-functional requirements.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Artificial in- telligence versus software engineers: An evidence-based assessment focusing on non-functional requirements

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:42.391818Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:39.329438Z digest=sha256:d1df733b7b43729162d7f50b551996a363b79ede4408bbb5abab4b8e0cdc8275

Observation f00245ef-d78a-4dc6-aa5d-6f4f34a12ea2 · outbound

This paper cites A Comprehensive Overview of Large Language Models.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems A Comprehensive Overview of Large Language Models

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-06T01:07:39.423507Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T01:07:39.423507Z digest=sha256:4f6236dfff07340a2388bac0fc2c26eb6c626fd7f8641532979535e05f8c3168

Observation 69055221-dc5e-434a-8325-af9d7c922386 · outbound

This paper cites An empirical evaluation of github copilot’s code suggestions.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems An empirical evaluation of github copilot’s code suggestions

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:42.102725Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:39.526712Z digest=sha256:94d6cd2b96f1ce70202d1d86077872dbb0a20a533b1c70ace17a6c38af1c0e2a

Observation 97159fbe-296d-4a00-9997-248e2a1359bf · outbound

This paper cites Gpt-4 technical report, 2024.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Gpt-4 technical report, 2024

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:41.899097Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:39.612826Z digest=sha256:c82e556532311455ec09156e84fe845d8dd9f3c4421d5fbdb55d7391c89a87b1

Observation 5d563f0e-0f7d-4f9a-8690-f0399272f6c4 · outbound

This paper cites an unresolved cited work.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-06T01:07:41.722154Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:39.691462Z digest=sha256:fa24198c728d9b123e5cfe03c8805f64a9331c211f5ce4865fe8bd49e4bf846d

Observation db60303d-a9c2-4e6e-a870-07a667680631 · outbound

This paper cites Choose your pro- gramming copilot: A comparison of the program synthesis performance of github copilot and genetic programming.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Choose your pro- gramming copilot: A comparison of the program synthesis performance of github copilot and genetic programming

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:41.478963Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:39.805619Z digest=sha256:35f81e44fd8fd63927e431517ed032405245158644add3b0c2c78edee6038109

Observation 16a71d48-7acc-4ce0-be26-a09f69aabb41 · outbound

This paper cites Stratascratch: Real-world data science coding chal- lenges.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Stratascratch: Real-world data science coding chal- lenges

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:41.245765Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:39.897855Z digest=sha256:f12120d0c2360968f1183427bb60b882e5cca59969963aa52f566a22564b6769

Observation c3c88cb7-39a9-44fe-bd32-11d2e32d635b · outbound

This paper cites K., F U, S., AND SUNDARESAN , N.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems K., F U, S., AND SUNDARESAN , N

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:41.061451Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:39.961387Z digest=sha256:93ae3f8ff3f03f16ffa4aaf6b3e34496ca55014cc5b2e00f4389ba9b9edf9143

Observation b8b3a4f1-732e-43e0-af5b-ed9321f7c557 · outbound

This paper cites Expectation vs.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems Expectation vs

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:40.814188Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:40.094265Z digest=sha256:5dcebbb902a35531bb6bbe5882307cc860e38570466fa97199674c6554f73775

Observation 563a90e9-4844-4286-b268-dba247cc0dc0 · outbound

This paper cites V., AND VAUGHAN , J.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems V., AND VAUGHAN , J

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T01:07:40.625871Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T01:07:40.136653Z digest=sha256:a432c24e25b9b5792e957fe8366e303b64a04e6fe9f0a868c02621bd5b44e3cd

Observation 6d0520ab-1ca3-40e9-96dc-2032cc54343c · outbound

This paper cites A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPT

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-06T01:07:40.262015Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T01:07:40.262015Z digest=sha256:7dce2692e02db684f59191dd1016531af03af4bf6816c921588a307fb5a26545

Observation f52ab0a2-1e64-468d-a84c-dc4bf98f0200 · outbound

This paper cites A Systematic Evaluation of Large Language Models of Code.

Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems A Systematic Evaluation of Large Language Models of Code

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-06T01:07:40.389625Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T01:07:40.389625Z digest=sha256:b8a90a1bc97acdd07db4d17b11e40cb3f322f82acb8734f9ff5cd10964194d46

Pith citing papers

Observation 931d7938-ed02-4e76-8d6e-35757bb86571 · inbound

Unlocking LLM Code Correction with Iterative Feedback Loops cites this paper.

Unlocking LLM Code Correction with Iterative Feedback Loops Analyzing Prominent LLMs: An Empirical Study of Performance and Complexity in Solving LeetCode Problems

Reference 24

Resolution
verified exact
arxiv_id, observed 2026-06-27T00:20:16.767351Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-06-27T00:13:28.707612Z digest=sha256:387293388297181d681948b1acbc5d25aaaeeaa6d75c3b36d739ab1980111448