Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-05T17:14:07.903751Z
Paper Citation Record · LEDGER
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation
As of 9 August 2026, this Paper Citation Record lists 24 of 24 outbound references and 0 inbound Pith citation observations for arXiv:2608.03535.
A citation records a reference. It does not transfer a finding from one paper to another.
Coverage vector
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links
A source-named dated measurement, never combined with another source.
Source: cited_works
Reference resolution
24 of 24 outbound references displayed
- verified exact0
- verified fuzzy19
- unresolved5
- parse uncertain0
- malformed identifier0
- metadata mismatch0
External citation measurements
No source-named external measurement is stored.
Outbound references
Observation e60e575f-6a50-4e9f-8633-511db4d4739a · outbound
This paper cites an unresolved cited work.
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation Unresolved cited work
Reference 1
- Resolution
- unresolved
- raw_fallback, observed 2026-08-05T17:14:08.524030Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.
Observation e8d4b94b-8de9-4d36-bd13-6be6ac86377b · outbound
This paper cites Program Synthesis with Large Language Models.
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation Program Synthesis with Large Language Models
Reference 2
- Resolution
- unresolved
- no resolver link, observed 2026-08-05T17:14:07.770257Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation bf20932a-f147-4de8-a8d3-df22327356f9 · outbound
This paper cites In: 2025 IEEE/ACM 2nd International Conference on AI Foundation Models and Software Engineering (FORGE).
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation In: 2025 IEEE/ACM 2nd International Conference on AI Foundation Models and Software Engineering (FORGE)
Reference 3
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T17:14:08.503473Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.
Observation bdcdd895-b877-4576-9b94-841e85899d12 · outbound
This paper cites Evaluating Large Language Models Trained on Code.
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation Evaluating Large Language Models Trained on Code
Reference 4
- Resolution
- unresolved
- no resolver link, observed 2026-08-05T17:14:07.784348Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b59d397d-8b35-4cae-a7f3-24a381b4da9c · outbound
This paper cites Biometrika 37(3–4), 256–266 (1950) 16 S.
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation Biometrika 37(3–4), 256–266 (1950) 16 S
Reference 5
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T17:14:08.483421Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.
Observation eeeb9676-1bd7-4eb4-83d2-21f2941a02bd · outbound
This paper cites In: Proc.
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation In: Proc
Reference 6
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T17:14:08.465692Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.
Observation 5580e694-9e1e-4a92-a9db-9194b0dba413 · outbound
This paper cites ACM Transactions on Software Engineering and Methodology33(8), 1–79 (2024).
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation ACM Transactions on Software Engineering and Methodology33(8), 1–79 (2024)
Reference 7
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T17:14:08.444260Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.
Observation 412fb120-6a9e-4fa2-ae8a-096aee8d52d4 · outbound
This paper cites an unresolved cited work.
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation Unresolved cited work
Reference 8
- Resolution
- unresolved
- raw_fallback, observed 2026-08-05T17:14:08.420614Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.
Observation 92093728-3b9b-4590-b160-603be860f058 · outbound
This paper cites In: Proc.
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation In: Proc
Reference 9
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T17:14:08.394550Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.
Observation 84fc1ddb-41c5-459c-8a75-f691c86db7ab · outbound
This paper cites In: International Conference on Learning Representations (2025).
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation In: International Conference on Learning Representations (2025)
Reference 10
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T17:14:08.373805Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.
Observation df03c12b-456f-436c-b5f1-17cd4322e26c · outbound
This paper cites 22nd ACM SIG- SOFT International Symposium on Foundations of Software Engineering (FSE).
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation 22nd ACM SIG- SOFT International Symposium on Foundations of Software Engineering (FSE)
Reference 11
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T17:14:08.354892Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.
Observation 89838c90-80b1-44a6-af73-97c29c575060 · outbound
This paper cites In: Advances in Neural Information Processing Systems (NeurIPS).
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation In: Advances in Neural Information Processing Systems (NeurIPS)
Reference 12
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T17:14:08.335032Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.
Observation eccda045-25e9-4bda-a555-bbfcee294331 · outbound
This paper cites IEEE Transactions on Software Engineering SE-2(4), 308–320 (1976).
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation IEEE Transactions on Software Engineering SE-2(4), 308–320 (1976)
Reference 13
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T17:14:08.315390Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.
Observation bf1b5c0f-1889-41da-8eb2-a179aa20fb61 · outbound
This paper cites In: Proc.
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation In: Proc
Reference 14
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T17:14:08.295485Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.
Observation a0f0014f-a1ba-4413-9fe4-d5ca283cde09 · outbound
This paper cites 2023 ACM SIGSAC Conference on Computer and Communications Security (CCS).
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation 2023 ACM SIGSAC Conference on Computer and Communications Security (CCS)
Reference 15
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T17:14:08.277024Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.
Observation c0661c0d-2b1d-47a8-a76e-a17b8f4c1a13 · outbound
This paper cites In: Proc.
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation In: Proc
Reference 16
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T17:14:08.254740Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.
Observation c80ca32c-6b47-4134-ba4d-6c8a9fe13f1b · outbound
This paper cites In: Proc.
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation In: Proc
Reference 17
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T17:14:08.233705Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.
Observation 3e177fa8-0e34-4a29-8099-2cdcdd0221b4 · outbound
This paper cites Journal of Systems and Software238, 112885 (2026).
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation Journal of Systems and Software238, 112885 (2026)
Reference 18
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T17:14:08.200963Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.
Observation f87d8bf3-ab62-4d9c-9c2a-e34075057b11 · outbound
This paper cites 42nd International Conference on Machine Learning (ICML).
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation 42nd International Conference on Machine Learning (ICML)
Reference 19
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T17:14:08.173527Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.
Observation 875e65b5-4d53-40ea-8719-1ede67dc42bc · outbound
This paper cites Biometrics Bulletin 1(6), 80–83 (1945) CodeAssay: A Multi-Metric, Audited Code-Generation Benchmark 17.
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation Biometrics Bulletin 1(6), 80–83 (1945) CodeAssay: A Multi-Metric, Audited Code-Generation Benchmark 17
Reference 20
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T17:14:08.147453Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.
Observation 1ed260ee-cfd6-45ff-8950-ddff883836e9 · outbound
This paper cites In: Proc.
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation In: Proc
Reference 21
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T17:14:08.120690Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.
Observation 71167ad2-66e9-4311-b64a-fc622995aa8e · outbound
This paper cites In: Proc.
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation In: Proc
Reference 22
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T17:14:08.095562Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.
Observation de004fe9-a825-4661-90da-7af60fb827bf · outbound
This paper cites Beyond Correctness: Benchmarking Multi-dimensional Code Generation for Large Language Models.
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation Beyond Correctness: Benchmarking Multi-dimensional Code Generation for Large Language Models
Reference 23
- Resolution
- unresolved
- no resolver link, observed 2026-08-05T17:14:07.898036Z
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f622dab2-246a-4223-a682-952f770d8a7e · outbound
This paper cites In: Proc.
CodeAssay: A Multi-Metric Benchmark with Audited Ground Truth for LLM Code Generation In: Proc
Reference 24
- Resolution
- verified fuzzy
- raw_fallback, observed 2026-08-05T17:14:08.060964Z
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.
Pith citing papers
No inbound Pith citation observations are available.