REVIEW 7 cited by
VeriGen: A Large Language Model for Verilog Code Generation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
In this study, we explore the capability of Large Language Models (LLMs) to automate hardware design by generating high-quality Verilog code, a common language for designing and modeling digital systems. We fine-tune pre-existing LLMs on Verilog datasets compiled from GitHub and Verilog textbooks. We evaluate the functional correctness of the generated Verilog code using a specially designed test suite, featuring a custom problem set and testing benches. Here, our fine-tuned open-source CodeGen-16B model outperforms the commercial state-of-the-art GPT-3.5-turbo model with a 1.1% overall increase. Upon testing with a more diverse and complex problem set, we find that the fine-tuned model shows competitive performance against state-of-the-art gpt-3.5-turbo, excelling in certain scenarios. Notably, it demonstrates a 41% improvement in generating syntactically correct Verilog code across various problem categories compared to its pre-trained counterpart, highlighting the potential of smaller, in-house LLMs in hardware design automation.
Forward citations
Cited by 7 Pith papers
-
AtumAI: A Principled Framework for Agentic Generation of Datacenter Control-Plane Policies
AtumAI compiles plain-language goals into a formal search problem and uses an LLM-plus-evolution loop to generate datacenter control-plane policies that beat hand-tuned baselines in simulation.
-
Open-Source LLM-Driven Formal Verification: A Multi-Agent Pipeline for RTL Repair
An open-source LLM-based pipeline repaired a simple ALU bug with k-induction proof, but succeeded on only 1 of 6 benchmarks.
-
AI Agents for Photonic Integrated Circuit Design Automation
PhIDO, a multi-agent LLM framework, generates GDSII photonic-chip layouts from natural language and, across seven models, the best achieve about 57% end-to-end pass@5 success for designs with 15 or fewer components.
-
BugGen: A Self-Correcting Multi-Agent LLM Pipeline for Realistic RTL Bug Synthesis
BugGen uses LLM agents to generate, insert, and validate realistic RTL bugs, reporting 94% validated yield and 104 mutations that escape the regression suite.
-
RTL++: Graph-enhanced LLM for RTL Code Generation
RTL++ encodes RTL code as textualized CFG/DFG graphs to generate richer instructions for fine-tuning CodeLlama-7B, claiming improved VerilogEval pass@k over comparable open-source models.
-
UVLLM: An Automated Universal RTL Verification Framework using LLMs
UVLLM uses LLM-generated reference models inside UVM testbenches to localize and repair RTL errors, reporting 86.99% syntax and 71.92% functional fix rates on a new 331-instance benchmark.
-
Generalizing Large Language Model Usability Across Resource-Constrained
The dissertation shows that text-centric prompting, inference-time optimization, and correct-by-construction synthetic data can improve LLM robustness and Verilog code generation under resource constraints.
Discussion (0). Continue with ORCID to comment.