Pith. sign in

Paper Citation Record · LEDGER

Synthesis-in-the-Loop Evaluation of LLMs for RTL Generation: Quality, Reliability, and Failure Modes

As of 4 August 2026, this Paper Citation Record lists 14 of 14 outbound references and 5 inbound Pith citation observations for arXiv:2603.11287.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2603.11287 v2

Coverage vector

measured 14 of 14 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-05-15T12:35:20.684017Z

measured 19 of 19 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-03T06:30:56.289259+00:00

measured 5 of 5 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-06-30T22:18:09.663488Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-07-01T14:05:46.785946Z

Reference resolution

14 of 14 outbound references displayed

  • verified exact7
  • verified fuzzy0
  • unresolved3
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch3

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 2b3f921f-0abe-4257-b7c2-608090cb031b · outbound

This paper cites an unresolved cited work.

Synthesis-in-the-Loop Evaluation of LLMs for RTL Generation: Quality, Reliability, and Failure Modes Unresolved cited work

Reference 1

Resolution
verified exact
doi, observed 2026-05-15T12:35:35.087238Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T12:35:20.684017Z digest=sha256:435bf992d4017ae8137cd9a4e49bf9ea0f74fa36faf8153cf293a1dbe10bd797

Observation 3ded47c2-59d9-4676-af15-ccfad39c9ab9 · outbound

This paper cites Program Synthesis with Large Language Models.

Synthesis-in-the-Loop Evaluation of LLMs for RTL Generation: Quality, Reliability, and Failure Modes Program Synthesis with Large Language Models

Reference 2

Resolution
metadata mismatch
local_arxiv, observed 2026-05-15T12:35:35.304974Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T12:35:20.684017Z digest=sha256:47a584c477d92e1e27af0e60280d377425f2fdbf320e1d3ea2ac52cf1c786f4b

Observation e0fbd77f-940b-4694-9f71-749f14308e44 · outbound

This paper cites Evaluating Large Language Models Trained on Code.

Synthesis-in-the-Loop Evaluation of LLMs for RTL Generation: Quality, Reliability, and Failure Modes Evaluating Large Language Models Trained on Code

Reference 3

Resolution
verified exact
local_arxiv, observed 2026-05-15T12:35:35.299797Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T12:35:20.684017Z digest=sha256:384237a59c9836fc1330e830469138da33d4da44d1fcc7cf8fcb31b6c14d4d3b

Observation 1ce84947-f201-45e6-b538-701a44ca004e · outbound

This paper cites Competition-Level Code Generation with AlphaCode.

Synthesis-in-the-Loop Evaluation of LLMs for RTL Generation: Quality, Reliability, and Failure Modes Competition-Level Code Generation with AlphaCode

Reference 4

Resolution
verified exact
arxiv_id, observed 2026-05-18T06:43:48.088484Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T12:35:20.684017Z digest=sha256:81448ccf3ea16688175ef083c8ebeb0b65bd91c06193c11c7c1cf3e6a4569526

Observation 27bc7571-a3a6-46da-8f7f-ff0c08f40fbf · outbound

This paper cites an unresolved cited work.

Synthesis-in-the-Loop Evaluation of LLMs for RTL Generation: Quality, Reliability, and Failure Modes Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-05-15T12:35:35.558076Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T12:35:20.684017Z digest=sha256:718ace3f2f472e861f9bd361aa14eadd1ee21750986e793b1e485caba79be099

Observation f91b8888-167b-406d-b2c7-ea93611098a7 · outbound

This paper cites URLhttps://doi.org/10.1109/ICCAD57390.2023.10323812.

Synthesis-in-the-Loop Evaluation of LLMs for RTL Generation: Quality, Reliability, and Failure Modes URLhttps://doi.org/10.1109/ICCAD57390.2023.10323812

Reference 6

Resolution
metadata mismatch
arxiv_id, observed 2026-05-15T12:35:35.119303Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T12:35:20.684017Z digest=sha256:ba99a2a653e813d50210c58846607b1a1b938a453c6d5dea766c8ca5c6977151

Observation 3b115309-9d4f-4883-b823-ffbc642be4d8 · outbound

This paper cites an unresolved cited work.

Synthesis-in-the-Loop Evaluation of LLMs for RTL Generation: Quality, Reliability, and Failure Modes Unresolved cited work

Reference 7

Resolution
verified exact
arxiv_id, observed 2026-05-15T12:35:35.094401Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T12:35:20.684017Z digest=sha256:bfebf313c0a0052571395ab76899540ccc79f8bc06d04bf092008362ca023509

Observation b24bd6f9-e662-41ae-803b-5cd9042ae25e · outbound

This paper cites In: Proceed- ings of the 43rd IEEE/ACM International Conference on Computer- Aided Design.

Synthesis-in-the-Loop Evaluation of LLMs for RTL Generation: Quality, Reliability, and Failure Modes In: Proceed- ings of the 43rd IEEE/ACM International Conference on Computer- Aided Design

Reference 8

Resolution
verified exact
arxiv_id, observed 2026-05-15T12:35:35.115192Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T12:35:20.684017Z digest=sha256:f95befedd09b2ea04c63efc7ae9042166938120cd10165aeefe2f81b6c9720c6

Observation 176547d2-a67d-4075-86c5-98c9ba27b726 · outbound

This paper cites doi: 10.1109/ASP-DAC58780.2024.

Synthesis-in-the-Loop Evaluation of LLMs for RTL Generation: Quality, Reliability, and Failure Modes doi: 10.1109/ASP-DAC58780.2024

Reference 9

Resolution
malformed identifier
arxiv_id, observed 2026-05-15T12:35:35.309492Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T12:35:20.684017Z digest=sha256:4e97b818ade67c24dfe8a9e821a451865e083e0b266fc90a5cc3ff95db218ade

Observation 6fb0c0bd-38c6-44d6-bc58-8db8b4fa7f15 · outbound

This paper cites an unresolved cited work.

Synthesis-in-the-Loop Evaluation of LLMs for RTL Generation: Quality, Reliability, and Failure Modes Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-05-15T12:35:35.564497Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T12:35:20.684017Z digest=sha256:def8f500cbb94799a773aa3a09b2613846f91067d74b8881ee2076bc0eb46857

Observation 52353519-307a-42de-9ec1-d9c762e5fec9 · outbound

This paper cites ACM Trans.

Synthesis-in-the-Loop Evaluation of LLMs for RTL Generation: Quality, Reliability, and Failure Modes ACM Trans

Reference 11

Resolution
verified exact
doi, observed 2026-05-15T12:35:35.104673Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T12:35:20.684017Z digest=sha256:902f3abd36a922d271c7d4d6a087cc636f0e733cb0f8b634ac5c2a151221a00f

Observation 13cab85d-eb1f-44bc-b871-c999cb58f8e7 · outbound

This paper cites an unresolved cited work.

Synthesis-in-the-Loop Evaluation of LLMs for RTL Generation: Quality, Reliability, and Failure Modes Unresolved cited work

Reference 12

Resolution
metadata mismatch
arxiv_id, observed 2026-05-15T12:35:35.110852Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T12:35:20.684017Z digest=sha256:b1be1c4adf6402e2da7e919b5e0078024021b489ca30bece805f86d0ac82e7c4

Observation 48449517-5a6d-4667-af0d-41f64be3a918 · outbound

This paper cites VeriGen: A large language model for verilog code generation.

Synthesis-in-the-Loop Evaluation of LLMs for RTL Generation: Quality, Reliability, and Failure Modes VeriGen: A large language model for verilog code generation

Reference 13

Resolution
verified exact
doi, observed 2026-05-15T12:35:35.101745Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T12:35:20.684017Z digest=sha256:105bb1df3e719898bcbb5e72b35de8686047bbe4bbaf6b1a5c62b8c7c0881411

Observation 627c7e4c-2e03-42d2-91a9-824009c4fbe4 · outbound

This paper cites an unresolved cited work.

Synthesis-in-the-Loop Evaluation of LLMs for RTL Generation: Quality, Reliability, and Failure Modes Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-05-15T12:35:35.561253Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-15T12:35:20.684017Z digest=sha256:7c2b6df3126741b41a2b13b454034615606de6cc27ea4d1b7e7327d73f29923c

Pith citing papers

Observation c6e20918-f1df-40d5-a142-c9df1330aea4 · inbound

Configuration Over Selection: Hyperparameter Sensitivity Exceeds Model Differences in Open-Source LLMs for RTL Generation cites this paper.

Configuration Over Selection: Hyperparameter Sensitivity Exceeds Model Differences in Open-Source LLMs for RTL Generation Synthesis-in-the-Loop Evaluation of LLMs for RTL Generation: Quality, Reliability, and Failure Modes

Reference 21

Resolution
verified exact
arxiv_id, observed 2026-05-12T02:45:01.666433Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-10T06:00:31.420896Z digest=sha256:d04082860c2cb13c3fa39871edb7ec0285e8dc4de1a546e2651b288258d246ec

Observation 462c96cb-4481-4b30-82e5-43f61eb4bb29 · inbound

LLMs for Secure Hardware Design and Related Problems: Opportunities and Challenges cites this paper.

LLMs for Secure Hardware Design and Related Problems: Opportunities and Challenges Synthesis-in-the-Loop Evaluation of LLMs for RTL Generation: Quality, Reliability, and Failure Modes

Reference 26

Resolution
verified exact
local_arxiv, observed 2026-05-12T06:51:26.469753Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-12T03:57:51.577486Z digest=sha256:0e714f8683e62080279ae30a6735e3f628db6648c813fdf8069697a139138c9e

Observation 49f7bb1d-27c3-49c2-9649-9e21bac8eefa · inbound

LLMs for Secure Hardware Design and Related Problems: Opportunities and Challenges cites this paper.

LLMs for Secure Hardware Design and Related Problems: Opportunities and Challenges Synthesis-in-the-Loop Evaluation of LLMs for RTL Generation: Quality, Reliability, and Failure Modes

Reference 27

Resolution
verified exact
local_arxiv, observed 2026-05-14T21:12:58.779129Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-14T21:12:08.821202Z digest=sha256:68b46acd26309bdb94d31739c73ecce0db5ffebf94c188bbb3d5fe9d3c5aecb8

Observation 5fb64926-a72d-4a30-8615-8de086a93bab · inbound

LLMs for Secure Hardware Design and Related Problems: Opportunities and Challenges cites this paper.

LLMs for Secure Hardware Design and Related Problems: Opportunities and Challenges Synthesis-in-the-Loop Evaluation of LLMs for RTL Generation: Quality, Reliability, and Failure Modes

Reference 27

Resolution
verified exact
local_arxiv, observed 2026-05-21T08:59:55.358678Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-21T08:58:25.469021Z digest=sha256:ebe386d9192e827d2fa5299c55788a40eeea4d94c031b266c09fd900df7e6910

Observation c2aab436-75af-41e0-bb79-daf941425a41 · inbound

LLMs for Secure Hardware Design and Related Problems: Opportunities and Challenges cites this paper.

LLMs for Secure Hardware Design and Related Problems: Opportunities and Challenges Synthesis-in-the-Loop Evaluation of LLMs for RTL Generation: Quality, Reliability, and Failure Modes

Reference 27

Resolution
verified exact
local_arxiv, observed 2026-07-01T14:05:46.787276Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-06-30T22:18:09.663488Z digest=sha256:3d90a0c4768f8811570ed52205ffff61634a5cd87c57a81f53a8e223572c9320