REVIEW 5 cited by
AutoVCoder: A Systematic Framework for Automated Verilog Code Generation using LLMs
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Recently, the use of large language models (LLMs) for software code generation, e.g., C/C++ and Python, has proven a great success. However, LLMs still suffer from low syntactic and functional correctness when it comes to the generation of register-transfer level (RTL) code, such as Verilog. To address this issue, in this paper, we develop AutoVCoder, a systematic open-source framework that significantly improves the LLMs' correctness of generating Verilog code and enhances the quality of its output at the same time. Our framework integrates three novel techniques, including a high-quality hardware dataset generation approach, a two-round LLM fine-tuning method and a domain-specific retrieval-augmented generation (RAG) mechanism. Experimental results demonstrate that AutoVCoder outperforms both industrial and academic LLMs in Verilog code generation. Specifically, AutoVCoder shows a 0.5% and 2.2% improvement in functional correctness on the EvalMachine and EvalHuman benchmarks compared with BetterV, and also achieves a 3.4% increase in syntax correctness and a 3.4% increase in functional correctness on the RTLLM benchmark compared with RTLCoder.
Forward citations
Cited by 5 Pith papers
-
HINT: Toward an Executable Hardware-Intent Representation Layer for LLM-Driven RTL Generation
HINT, an executable hardware-intent representation with explicit architecture commitments and RTL-lowering obligations, improves LLM-generated RTL correctness and area across seven operator cases and three larger designs.
-
RealBench: Benchmarking Verilog Generation Models with Real-World IP Designs
RealBench measures LLM Verilog generation on complex open-source IP cores with formal verification, and all tested models score near zero on full system designs.
-
RTL++: Graph-enhanced LLM for RTL Code Generation
RTL++ encodes RTL code as textualized CFG/DFG graphs to generate richer instructions for fine-tuning CodeLlama-7B, claiming improved VerilogEval pass@k over comparable open-source models.
-
MAGE: A Multi-Agent Engine for Automated RTL Code Generation
MAGE, a multi-agent LLM pipeline with high-temperature sampling and state-checkpoint debugging, reports 95.7% Pass@1 on VerilogEval-V2, but the evaluation includes the golden testbench as generation input.
-
VerilogDB: The Largest, Highest-Quality Dataset with a Preprocessing Framework for LLM-based RTL Generation
A new pipeline and dataset of 20,392 synthesis-checked Verilog modules for LLM fine-tuning is presented, claimed to be the largest high-quality dataset of its kind.
Discussion (0). Continue with ORCID to comment.