REVIEW 3 major objections 5 minor 2 cited by
GraCo -- A Graph Composer for Integrated Circuits
T0 review · 3 major / 5 minor · reviewed 2026-08-12 · deepseek-v4-flash
Pith's one-line read The paper claims that a reinforcement-learning agent which assembles circuits graph by graph and receives SPICE simulation rewards can beat random search, finding a verified inverter in about five times fewer sampling steps and a…
desk verdict A working RL graph-composer for circuit synthesis with a useful consistency-check idea, but the 2.5x NAND2 speedup is a best-of-run artifact and the claims need more runs and stronger baselines. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the graph itself, with nets and component terminals as nodes and with each component's terminals forming a complete subgraph, so terminal identity needs no edge features. GraCo assembles this graph with a DeeperGCN, a graph convolutional network with skip connections, that reads the partially built graph and outputs logits for the next action, logits for choosing a component, means and log-variances for sizing parameters, and logits connecting each new terminal to an existing net. Two learning algorithms drive the search: RLOO, a REINFORCE variant with a leave-one-out baseline, and evolution strategies with mirrored sampling. The second key mechanism is a set of four graph consistency checks: connected input/output nets, a path from every input to every output, no floating nets, and no isolated subgraphs. These checks can be used to block premature stopping, to resample invalid graphs, or to augment the GCN input features, and they reduce the number of SPICE simulations spent on circuits that would fail anyway.
What would settle it
Run the same GraCo ES configuration on a larger standard cell, such as a 3-input NAND or full adder, with identical wiring rules and step limits scaled to the task; if the sampling-step advantage over random search disappears or becomes negative as the space grows, then the 5x and 2.5x results are artifacts of the small constrained inverter and NAND2 spaces rather than of the learned composer.
Extended reading notes
Core claim
GraCo's central claim is that circuit synthesis reduces to an autoregressive graph-generation problem that a reinforcement-learning agent can solve with fewer SPICE simulations than a random sampler. At each step the agent chooses one of three actions: add an internal net, add a component with continuously sampled sizing parameters, or stop generation and send the graph to SPICE. The paper reports that training this policy with evolution strategies rather than with RLOO, a leave-one-out-baseline REINFORCE variant, is the key to reliable search: ES finds a verified inverter in about five times fewer steps than random, and for NAND2 it discovers a circuit whose best reward corresponds to a gate that is on average 2.5 times faster than the random baseline's best. Consistency checks that reject invalid graphs before or after simulation make the search more efficient; on the NAND2 task, using all checks together raises the average best reward for the ES variant from 0.88 to 0.90. These results are presented as evidence that topology search and sizing can be learned jointly rather than assumed from a fixed circuit library.
Load-bearing premise
The results assume that with the hand-set step limits (6 for inverter, 10 for NAND2) and mandatory wiring rules (bulk to supply/ground, no supply to gate), the remaining design space is large enough that the learned policy, and not the constraints, produces the reported gain over random search.
Editorial extensions
If this is right
- If the results hold, topology search and transistor sizing can be optimized in one reinforcement-learning loop rather than in separate fixed-topology sizing steps.
- The consistency-check mechanism is not tied to a particular component library, so the same four checks should transfer to other graph-based synthesis tasks.
- Because ES outperformed RLOO on both tasks, exploration-oriented search is a better fit than exploitation-heavy policy gradients when the goal is a single best circuit rather than a reusable policy.
- Adding subcircuits to the inventory lets designers inject existing IP blocks into the search without changing the underlying graph procedure.
- Using all consistency checks during or after generation yielded the best average reward for the ES variant, while feeding the checks as extra GCN inputs did not help (0.86).
Reading between the lines
- A testable extension the paper leaves implicit: on larger design spaces where invalid graphs are more common, pruning with consistency checks should yield a larger speedup than the 5x observed on an inverter.
- The comparison against random sampling leaves open how GraCo would fare against other learned topology or sizing tools on the same cells; a direct benchmark would clarify where the bounds lie.
- The paper's single-best-instance goal suggests that an explicit replay buffer of successful circuits, which the authors list as future work, could turn GraCo into a reusable prior for new cells rather than a per-task search.
- The consistency-check idea is purely graph-theoretic, so it might also apply to other autoregressive graph generators such as molecule synthesis or analog layout exploration.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes GraCo, an autoregressive graph-generation framework for integrated-circuit synthesis in which a graph neural network (DeeperGCN) sequentially adds nets and components, converts the assembled graph to a SPICE netlist, and scores it with a reward derived from transient simulation. Two optimization strategies are considered, REINFORCE with a leave-one-out baseline (RLOO) and evolution strategies (ES), and the framework allows the injection of design knowledge through explicit wiring rules, reward shaping, component limits, and graph consistency checks. Experiments are reported for two standard-cell tasks: an inverter and a two-input NAND gate. The headline claims are that ES finds the inverter with approximately 5× fewer sampling steps than a random baseline and that ES synthesizes a NAND2 gate that is 2.5× faster than the random baseline's best result, with consistency checks improving sampling efficiency. The manuscript describes the task setup, the graph representation, the consistency-check taxonomy, and an ablation table over consistency-check variants.
Significance. If the empirical claims were supported, GraCo would be a genuinely useful contribution to ML-based circuit synthesis: it jointly searches topology and sizing, is not tied to a fixed cell library, and formalizes several ways to inject expert knowledge (wiring rules, consistency checks, subcircuits). The paper is also honest about negative results, such as RLOO's premature convergence, and it reports multi-run data (30 runs for the inverter, 3 runs per NAND2 configuration). The stress-test worry that the design space is too constrained to make learning matter is not supported by the paper's own Table I: even after the mandatory wiring rules, the NAND2 topology space is on the order of 1e8–1e10 configurations. The weakness lies not in the task difficulty but in the reported comparisons: the NAND2 speedup claim is obtained by selecting the best run from different consistency-check settings, which is not a controlled comparison. The framework itself is plausible and the consistency-check ablation is informative, but the headline quantitative claims need to be re-established with paired, statistically grounded comparisons.
major comments (3)
- [Sec. V-B, Table II, Eq. (4)] The headline '2.5× faster NAND2' is not supported by the table as reported. The value 2.48 arises from sqrt(4.08e-4 / 6.66e-5), which compares the single best random run under 'Connected in/out nets (during generation)' with the single best ES run under 'No floating nets (GraCo input)'. These are different consistency-check configurations, and the ES run uses a GraCo-input mechanism that the random baseline cannot use. Under the pure 'None' row, the ratio is only sqrt(1.33e-1 / 8.13e-2) ≈ 1.28. Moreover, for the 'All (during generation)' configuration highlighted in the consistency-check discussion, the best random gap (6.77e-2) and best ES gap (6.79e-2) imply essentially no speedup. A fair comparison must be made per configuration, with paired runs and with explicitly reported delay values or confidence intervals, not by post-hoc selection of the best run from 15 different settings.
- [Sec. V-B, Table II] The companion claim that ES is 'on average 30% faster than RLOO' is also a best-of-runs comparison, not an average: sqrt(1.34e-4 / 6.66e-5) ≈ 1.42 gives the 30% figure by comparing the single best RLOO gap (Paths after generation, Run 1) with the single best ES gap (No floating nets GraCo input, Run 1). With only three runs per configuration and no per-run delay values, no error bars, and no paired comparison under a fixed configuration, the word 'on average' is misleading. The authors should either report mean/median delays with variability across a fixed setting or soften the claim accordingly.
- [Sec. V-A, Fig. 5] The inverter claim of '5× fewer sampling steps' is reported as a median ratio over 30 runs, but the figure does not show confidence intervals, and the text does not state whether the median is computed over successful runs only or over all runs (with failures counted at the 1024-step limit). Because the ratio of medians is a nonlinear statistic, a bootstrap confidence interval or at least explicit median and interquartile ranges should be reported. The current presentation leaves the magnitude of the improvement and its uncertainty unclear, which matters because the 5× figure is one of the two headline contributions.
minor comments (5)
- [Abstract and Sec. V-B] The phrase 'random baseline' is used inconsistently: the 2.5× claim compares ES with a random run that uses a consistency check, whereas the pure random baseline without any consistency check is much slower. Please specify which configuration of the random baseline is being compared in each claim.
- [Table II] The table reports only 'Optimality gap = 1 − Best reward' without giving the normalization factor m_norm from Eq. (4). Since delay is proportional to sqrt(gap) under the squared error reward, the reader should be told the m_norm used and, ideally, the absolute delay values for the best circuits, to make the speedup interpretation transparent.
- [Sec. III-A] The description of the 'No floating nets' check says 'all internal or output nodes are either unconnected or connected to at least two terminal nodes'; the phrase 'unconnected or' appears contradictory to the intent of preventing floating nodes and should be clarified.
- [Sec. II-C, Eq. (2)] The entropy regularization term is written as λH(πθ(·|st)) inside the sum over t; it should be made explicit whether H is a per-step entropy and whether the sum runs over all time steps, to avoid ambiguity in the loss definition.
- [Fig. 3 and Table I] The label 'until standard gate' in Table I is not defined in the text; please clarify whether it means the number of topologies that produce the standard-cell topology at exactly the minimal number of steps.
Circularity Check
No significant circularity found: GraCo's reward is an explicit objective, consistency checks are structural filters, and benchmarks are external random and SPICE baselines.
full rationale
GraCo's derivation chain is self-contained. The reward function (Eq. 4) is an explicitly specified objective that converts user-set targets for voltages and timings into a scalar reward; it does not secretly encode the discovered circuit or the claimed speedup. The learned policy and its ES perturbations are evaluated against SPICE simulations and compared with a random uniform sampler, which is an external benchmark rather than a fitted input. The consistency checks presented in Sec. III-A are structural validity filters (connected input/output nets, paths between inputs and outputs, no floating nets, no isolated subgraphs) and do not assume the target circuit topology, its timing, or its reward value. No load-bearing step relies on a self-citation: the cited references for DeeperGCN, RLOO, and evolution strategies are standard external sources, and no uniqueness theorem or prior result by the authors is invoked to force the chosen approach. The paper itself states that only the single best instance matters rather than the final policy, and the reported 2.5x NAND2 speedup is computed from the optimality gaps in Table II via Eq. 4; this is a post-hoc best-of-runs evaluation choice that raises a statistical-reporting concern, but it is not a circular derivation. The inverter 5x sampling-step reduction is measured against the random baseline in Fig. 5 using sampling-step and wall-clock distributions. No prediction in the paper reduces, by construction, to its own inputs.
Assumptions & free parameters
free parameters (6)
- Reward targets, normalization, and saturation thresholds for inverter/NAND2 =
Not fully reported (e.g., mtar = 0 delay, rmin from cell specs)
- Maximum sampling steps =
6 (inverter), 10 (NAND2)
- ES perturbation scale sigma_ES =
0.05
- Entropy weight lambda (RLOO) =
0.01
- Minibatch size and training steps =
256, 1024
- Consistency-check configuration =
Best results reported for 'All (during generation)' in ES; 'No floating nets (after generation)' helps random baseline
assumptions (5)
- domain assumption SPICE simulation of the SkyWater SKY130 PDK accurately captures functional and timing behavior of synthesized circuits.
- domain assumption The nets-and-terminals graph representation is sufficient for the GNN to learn circuit semantics.
- ad hoc to paper The four consistency checks are sufficient to avoid SPICE-invalid circuits without excluding valuable designs.
- domain assumption Random sampling is a competitive baseline for small design spaces.
- standard math The Bell-number and topology design-space bounds correctly characterize the search space.
Cite this review
Pith. "Pith review of GraCo -- A Graph Composer for Integrated Circuits." pith.science (2026). https://pith.science/paper/2K7N3VV6
@misc{pith2026241113890,
author = {Pith},
title = {Pith review of: GraCo -- A Graph Composer for Integrated Circuits},
year = {2026},
howpublished = {\url{https://pith.science/paper/2K7N3VV6}},
note = {Machine review of arXiv:2411.13890}
}
read the original abstract
Designing integrated circuits involves substantial complexity, posing challenges in revealing its potential applications - from custom digital cells to analog circuits. Despite extensive research over the past decades in building versatile and automated frameworks, there remains open room to explore more computationally efficient AI-based solutions. This paper introduces the graph composer GraCo, a novel method for synthesizing integrated circuits using reinforcement learning (RL). GraCo learns to construct a graph step-by-step, which is then converted into a netlist and simulated with SPICE. We demonstrate that GraCo is highly configurable, enabling the incorporation of prior design knowledge into the framework. We formalize how this prior knowledge can be utilized and, in particular, show that applying consistency checks enhances the efficiency of the sampling process. To evaluate its performance, we compare GraCo to a random baseline, which is known to perform well for smaller design space problems. We demonstrate that GraCo can discover circuits for tasks such as generating standard cells, including the inverter and the two-input NAND (NAND2) gate. Compared to a random baseline, GraCo requires 5x fewer sampling steps to design an inverter and successfully synthesizes a NAND2 gate that is 2.5x faster.
Figures
Figures from the paper (3 more)
Forward citations
Cited by 2 Pith papers
-
Schemato -- An LLM for Netlist-to-Schematic Conversion
A fine-tuned LLM converts circuit netlists to LTSpice .asc schematics with higher compilation and structural similarity than GPT-4o and Llama baselines.
-
SPECS: Speciated Evolutionary Circuit Synthesis
SPECS, a NEAT-inspired evolutionary algorithm with circuit-native genomes and speciation, outperforms prior synthesis methods on four computational analog circuit tasks in success rate and mean error.
Reference graph
Works this paper leans on
-
[1]
The invention of cmos amplifiers us- ing genetic programming and current-flow analysis,
T. Sripramong and C. Toumazou, “The invention of cmos amplifiers us- ing genetic programming and current-flow analysis,” IEEE transactions on computer-aided design of integrated circuits and systems , vol. 21, no. 11, pp. 1237–1252, 2002
work page 2002
-
[2]
Topology synthesis of analog circuits with yield optimization and evaluation using pareto fronts,
O. Mitea, M. Meissner, and L. Hedrich, “Topology synthesis of analog circuits with yield optimization and evaluation using pareto fronts,” in 2011 IEEE/IFIP 19th International Conference on VLSI and System-on- Chip. IEEE, 2011, pp. 78–81
work page 2011
-
[3]
FEATS: Framework for explorative analog topology synthesis,
M. Meissner and L. Hedrich, “FEATS: Framework for explorative analog topology synthesis,” IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems , vol. 34, no. 2, pp. 213–226, 2014
work page 2014
-
[4]
Y . Yang, H. Zhu, Z. Bi, C. Yan, D. Zhou, Y . Su, and X. Zeng, “Smart- MSP: A self-adaptive multiple starting point optimization approach for analog circuit synthesis,” IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems , vol. 37, no. 3, pp. 531–544, 2017
work page 2017
-
[5]
Analog circuit topology synthesis by means of evolutionary computation,
ˇZ. Rojec, ´A. B ˝urmen, and I. Fajfar, “Analog circuit topology synthesis by means of evolutionary computation,” Engineering Applications of Artificial Intelligence, vol. 80, pp. 48–65, 2019
work page 2019
-
[6]
Analog circuit synthesis: A search for the holy grail?
S. A. Huss, “Analog circuit synthesis: A search for the holy grail?” in 2006 IEEE International Symposium on Circuits and Systems . IEEE, 2006, pp. 4–pp
work page 2006
-
[7]
Autockt: Deep reinforcement learning of analog circuit designs,
K. Settaluri, A. Haj-Ali, Q. Huang, K. Hakhamaneshi, and B. Nikolic, “Autockt: Deep reinforcement learning of analog circuit designs,” in 2020 Design, Automation & Test in Europe Conference & Exhibition (DATE). IEEE, 2020, pp. 490–495
work page 2020
-
[8]
An automated topology synthesis framework for analog integrated circuits,
Z. Zhao and L. Zhang, “An automated topology synthesis framework for analog integrated circuits,” IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems , vol. 39, no. 12, pp. 4325– 4337, 2020
work page 2020
Show all 34 references
-
[9]
From specifi- cation to topology: Automatic power converter design via reinforcement learning,
S. Fan, N. Cao, S. Zhang, J. Li, X. Guo, and X. Zhang, “From specifi- cation to topology: Automatic power converter design via reinforcement learning,” in 2021 IEEE/ACM International Conference On Computer Aided Design (ICCAD) . IEEE, 2021, pp. 1–9
2021
-
[10]
Dnn-opt: An RL inspired optimization for analog circuit sizing using deep neural networks,
A. F. Budak, P. Bhansali, B. Liu, N. Sun, D. Z. Pan, and C. V . Kashyap, “Dnn-opt: An RL inspired optimization for analog circuit sizing using deep neural networks,” in 2021 58th ACM/IEEE Design Automation Conference (DAC). IEEE, 2021, pp. 1219–1224
2021
-
[11]
Analog integrated circuit topology synthesis with deep reinforcement learning,
Z. Zhao and L. Zhang, “Analog integrated circuit topology synthesis with deep reinforcement learning,” IEEE Transactions on Computer- Aided Design of Integrated Circuits and Systems , vol. 41, no. 12, pp. 5138–5151, 2022
2022
-
[12]
Total: Topology op- timization of operational amplifier via reinforcement learning,
Z. Chen, S. Meng, F. Yang, L. Shang, and X. Zeng, “Total: Topology op- timization of operational amplifier via reinforcement learning,” in 2023 24th International Symposium on Quality Electronic Design (ISQED) . IEEE, 2023, pp. 1–8
2023
-
[13]
Automatic op-amp generation from specification to layout,
J. Lu, L. Lei, J. Huang, F. Yang, L. Shang, and X. Zeng, “Automatic op-amp generation from specification to layout,” IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems , 2023
2023
-
[14]
Cktgnn: Circuit graph neural network for electronic design automation,
Z. Dong, W. Cao, M. Zhang, D. Tao, Y . Chen, and X. Zhang, “Cktgnn: Circuit graph neural network for electronic design automation,” arXiv preprint arXiv:2308.16406, 2023
2023 arXiv
-
[15]
Apostle: Asyn- chronously parallel optimization for sizing analog transistors using dnn learning,
A. F. Budak, D. Smart, B. Swahn, and D. Z. Pan, “Apostle: Asyn- chronously parallel optimization for sizing analog transistors using dnn learning,” in Proceedings of the 28th Asia and South Pacific Design Automation Conference, 2023, pp. 70–75
2023
-
[16]
Automated topology synthesis of analog integrated circuits with frequency compensation,
Z. Zhao, J. Liu, W. Zhao, and L. Zhang, “Automated topology synthesis of analog integrated circuits with frequency compensation,” IEEE Trans- actions on Computer-Aided Design of Integrated Circuits and Systems , 2024
2024
-
[17]
A characterization of the bell numbers,
M. Aigner, “A characterization of the bell numbers,” Discrete mathe- matics, vol. 205, no. 1-3, pp. 207–210, 1999
1999
-
[18]
The sizing rules method for analog integrated circuit design,
H. Graeb, S. Zizala, J. Eckmueller, and K. Antreich, “The sizing rules method for analog integrated circuit design,” in IEEE/ACM International Conference on Computer Aided Design. ICCAD 2001. IEEE/ACM Digest of Technical Papers (Cat. No. 01CH37281). IEEE, 2001, pp. 343–349
2001
-
[19]
Fifty nifty variations of two-transistor circuits: A tribute to the versatility of mosfets,
H. Pretl and M. Eberlein, “Fifty nifty variations of two-transistor circuits: A tribute to the versatility of mosfets,”IEEE Solid-State Circuits Magazine, vol. 13, no. 3, pp. 38–46, 2021
2021
-
[20]
Subgemini: Iden- tifying subcircuits using a fast subgraph isomorphism algorithm,
M. Ohlrich, C. Ebeling, E. Ginting, and L. Sather, “Subgemini: Iden- tifying subcircuits using a fast subgraph isomorphism algorithm,” in Proceedings of the 30th International Design Automation Conference , 1993, pp. 31–37
1993
-
[21]
Gana: Graph convolutional network based automated netlist annotation for analog circuits,
K. Kunal, T. Dhar, M. Madhusudan, J. Poojary, A. Sharma, W. Xu, S. M. Burns, J. Hu, R. Harjani, and S. S. Sapatnekar, “Gana: Graph convolutional network based automated netlist annotation for analog circuits,” in 2020 Design, Automation & Test in Europe Conference & Exhibition...
2020
-
[22]
Paragraph: Layout parasitics and device parameter prediction using graph neural networks,
H. Ren, G. F. Kokai, W. J. Turner, and T.-S. Ku, “Paragraph: Layout parasitics and device parameter prediction using graph neural networks,” in 2020 57th ACM/IEEE Design Automation Conference (DAC). IEEE, 2020, pp. 1–6
2020
-
[23]
Pretraining graph neural networks for few-shot analog circuit modeling and design,
K. Hakhamaneshi, M. Nassar, M. Phielipp, P. Abbeel, and V . Stojanovic, “Pretraining graph neural networks for few-shot analog circuit modeling and design,” IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems , vol. 42, no. 7, pp. 2163–2173, 2022
2022
-
[24]
Deepgcns: Can gcns go as deep as cnns?
G. Li, M. Muller, A. Thabet, and B. Ghanem, “Deepgcns: Can gcns go as deep as cnns?” in Proceedings of the IEEE/CVF international conference on computer vision , 2019, pp. 9267–9276
2019
-
[25]
Deepergcn: All you need to train deeper gcns,
G. Li, C. Xiong, A. Thabet, and B. Ghanem, “Deepergcn: All you need to train deeper gcns,” arXiv preprint arXiv:2006.07739 , 2020
2006 arXiv
-
[26]
Graph convolutional networks: a comprehensive review,
S. Zhang, H. Tong, J. Xu, and R. Maciejewski, “Graph convolutional networks: a comprehensive review,” Computational Social Networks , vol. 6, no. 1, pp. 1–23, 2019
2019
-
[27]
Simple statistical gradient-following algorithms for connectionist reinforcement learning,
R. J. Williams, “Simple statistical gradient-following algorithms for connectionist reinforcement learning,” Machine learning , vol. 8, pp. 229–256, 1992
1992
-
[28]
Buy 4 reinforce samples, get a baseline for free!
W. Kool, H. van Hoof, and M. Welling, “Buy 4 reinforce samples, get a baseline for free!” in Proceedings of the ICLR 2019 Workshop: Deep RL Meets Structured Prediction , 2019
2019
-
[29]
Evolution strategies as a scalable alternative to reinforcement learning,
T. Salimans, J. Ho, X. Chen, S. Sidor, and I. Sutskever, “Evolution strategies as a scalable alternative to reinforcement learning,” arXiv preprint arXiv:1703.03864, 2017
2017 arXiv
-
[30]
Antithetic acceleration of monte carlo integration in bayesian inference,
J. Geweke, “Antithetic acceleration of monte carlo integration in bayesian inference,” Journal of Econometrics , vol. 38, no. 1-2, pp. 73– 89, 1988
1988
-
[31]
Skywater 130nm PDK,
Google and SkyWater Technology Foundry, “Skywater 130nm PDK,”
-
[32]
Safe and efficient off-policy reinforcement learning,
R. Munos, T. Stepleton, A. Harutyunyan, and M. Bellemare, “Safe and efficient off-policy reinforcement learning,” Advances in neural information processing systems , vol. 29, 2016
2016
-
[33]
Top-k off-policy correction for a reinforce recommender system,
M. Chen, A. Beutel, P. Covington, S. Jain, F. Belletti, and E. H. Chi, “Top-k off-policy correction for a reinforce recommender system,” in Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining , 2019, pp. 456–464
2019
-
[2020]
Available: https://github.com/google/skywater-pdk
[Online]. Available: https://github.com/google/skywater-pdk
Reviewed August 12, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.