REVIEW 4 major objections 5 minor 31 references
Effective Analog ICs Floorplanning with Relational Graph Neural Networks and Reinforcement Learning
T0 review · 4 major / 5 minor · reviewed 2026-08-12 · deepseek-v4-flash
Pith's one-line read An RL agent augmented by a pre-trained relational graph network can floorplan industrial analog circuits faster and with less area than established metaheuristics and, in many cases, than manual engineers.
desk verdict Solid RL/GNN analog floorplanner with real industrial tests, but the abstract's headline area and time reductions cherry-pick the layouts that improved. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the pre-trained R-GCN encoder: a relational graph convolutional network that consumes a heterogeneous graph of the circuit, where nodes are functional blocks or devices with features like area and a one-hot functional-type code, and edges are connectivity, alignment or symmetry relations. It is trained (after removing its fully-connected heads) on 21,600 floorplans produced by SA, GA, and PSO to predict their reward; the resulting embeddings are then fed to the RL agent alongside CNN-encoded masks (current grid, proxy wirelength increase, empty-space increase, and shape-specific placement masks). The paper's contribution is the claim that this reward-aligned graph representation is what lets the same RL policy transfer across distinct circuit topologies and constraints.
What would settle it
Take a circuit whose functional blocks (or their combinations) do not appear in the R-GCN pre-training set, run the zero-shot agent on it, and compare against a version of the same agent whose R-GCN encoder was randomly initialized instead of pre-trained; if the pre-trained encoder does not improve reward, area, or HPWL, or if the zero-shot floorplan violates symmetry or overlap constraints, the central transfer claim is unsupported.
Extended reading notes
Core claim
The central claim, in the authors' own terms, is that a hybrid R-GCN and RL system produces better analog floorplans than established metaheuristics and prior RL methods. The R-GCN is pre-trained to predict a placement reward for a circuit graph; its frozen encoder then supplies node and graph embeddings to a PPO agent that places functional blocks on a 32x32 grid, using action masks to enforce symmetry, alignment and non-overlap. With hybrid curriculum training on five circuits, the agent is claimed to generalize zero-shot to three unseen circuits, and to beat SA, GA, PSO and earlier RL baselines on reward, HPWL, dead space or runtime after a short fine-tuning. Integrated with the ANAGEN procedural generator and OARSMT global routing, the method reportedly yields complete DRC/LVS-clean layouts of the same quality as manual design in hours instead of days.
Load-bearing premise
The whole transfer story rests on the assumption that the R-GCN encoder, pre-trained on floorplans generated by metaheuristics for a specific set of analog circuit families, learns a representation of circuit structure that transfers to arbitrary new circuits; if the training set or the one-hot functional encoding misses what matters for a novel circuit, the zero-shot and few-shot gains disappear.
Editorial extensions
If this is right
- One policy, once trained on a few circuits, can be re-used across an analog design library; per-circuit optimization time drops from hours of metaheuristic search to seconds of inference.
- Because the agent outputs routing-ready floorplans without congestion estimation, the downstream global router can be simpler and the whole layout pipeline shorter.
- The method's action masking makes constraint satisfaction (symmetry, alignment, non-overlap) a property of the policy, reducing the need for post-generation checking and repair.
- In combination with ANAGEN, an engineer can go from netlist to DRC/LVS-clean layout of a simple block in a fraction of the manual time, making early design iterations cheaper.
Reading between the lines
- The architecture decouples the expensive part (pre-training the graph encoder on 21,600 metaheuristic floorplans) from the per-circuit cost (seconds of RL inference), so the economics improve as the encoder is reused across more designs, but only if the pre-training distribution stays representative.
- Since the R-GCN is trained on reward labels from metaheuristics, the same scaffolding could be pointed at different objectives such as routability, current density, or thermal gradients by swapping the reward oracle, yielding transferable encoders for other physical-design decisions.
- A cheaper curriculum or a smaller pre-training set might give the same transfer, but the paper does not ablate that; benchmarking the sample complexity of the encoder pre-training would tell an industrial team where to spend compute.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a floorplanning method for analog ICs that combines a relational graph convolutional network (R-GCN) encoder with a reinforcement learning (RL) agent. The R-GCN is pre-trained to predict floorplan rewards and then used as a graph-embedding module; a CNN processes grid masks; a masked PPO agent selects shapes and grid positions for circuit blocks. The method is evaluated on six industrial circuits against SA, GA, PSO, and two prior RL-based methods, with zero-shot and few-shot fine-tuning. The authors also integrate the floorplanner into the ANAGEN procedural layout generator and compare three completed layouts against manual layouts, reporting a 67.3% layout-time reduction and an 8.3% mean area reduction.
Significance. If substantiated, the work would demonstrate a practical RL-based analog floorplanning system with transfer across circuit topologies, tested on industrial designs. The paper includes a substantial training setup (21,600 pre-training floorplans, 12.7 hours of RL training) and a clear MDP formulation with action masking. However, the central quantitative claims in the abstract are not reproducible from the reported tables, the baseline comparison may favor the proposed method through asymmetric congestion-aware spacing, and the contribution of the R-GCN is not isolated via ablation. These issues prevent the results from being taken at face value.
major comments (4)
- [V-C (Table II) and Abstract] The abstract claims an 8.3% mean area reduction compared to manual layout, but Table II reports area changes of -14.1%, +52.1%, and -2.43% for OTA, Bias-1, and Driver, respectively. The mean across all three circuits is +11.9%, i.e., an area increase, not a reduction. The -8.3% value corresponds to averaging only OTA and Driver, excluding Bias-1; the exclusion is mentioned in Section V-C but not in the abstract. Similarly, the claimed 67.3% overall layout-time reduction is not derivable from Table II under any clearly stated aggregation rule: including the manual improvement time for the Driver circuit yields an automated total that exceeds the manual layout time. The authors must state the exact aggregation and the Bias-1 caveat in the abstract, or revise the claims to match the data.
- [V-B (Table I)] The statement "For a fair comparison, congestion-aware device spacing is applied to all other approaches" creates an asymmetry: the proposed method's floorplans are measured without this spacing, while all baselines have it. Since Table I reports floorplan metrics (dead space, HPWL) before routing, this inflates the baselines' dead space and biases the comparison in favor of the proposed method. To support the fairness claim, the authors should either apply the same congestion-aware spacing to the proposed method in Table I, or demonstrate that the proposed floorplans are routable without extra spacing for all six evaluated circuits, not only for the three in Table II.
- [IV-C, IV-D] The paper attributes the generalization ability of the approach to the R-GCN encoder, but no ablation is provided in which the RL agent is trained without the R-GCN (e.g., using only the CNN masks and grid features). The comparison with the RL method from [13] is not an adequate control because that prior work uses a different sequence-pair representation and does not share the same architecture. Without such an ablation, the specific contribution of the R-GCN to the reported rewards and transferability is not established. Additionally, no prediction accuracy of the pre-trained R-GCN reward model is reported, so it is unclear whether the encoder actually learns meaningful circuit features.
- [V-B (Table I)] The text claims the method "surpasses established floorplanning techniques in terms of speed, area and half-perimeter wire length" for the six circuits, but Table I does not report area; it reports dead space, HPWL, and reward. The reward is the training objective of the proposed agent (Eq. 5), so comparing rewards alone is not an independent evaluation. Area is reported only for the three circuits in Table II, which cannot support a six-circuit area claim. Please report area for all evaluated circuits in Table I or qualify the claim to dead space and HPWL.
minor comments (5)
- [Abstract and V-C] The abstract states "Applied to 6 industrial circuits..." but the 67.3% time and 8.3% area reductions appear to refer only to the three circuits in Table II. Clarify that the manual-layout comparison is on a subset of three circuits.
- [IV-C] The composition of the 21,600 pre-training floorplans is not described (e.g., number of circuits per type, distribution of constrained vs. unconstrained cases, and how rewards were computed). This information is needed to assess the source of the R-GCN's transferability.
- [V-B (Table I)] The terms "1-shot", "100-shot", and "1000-shot" are not defined; specify whether they denote the number of fine-tuning episodes, gradient steps, or something else.
- [IV-D5] The hybrid curriculum learning schedule is described only by the probabilities pcircuit and pconstraint; the order in which circuits of increasing complexity are introduced and the criterion for "growing complexity" should be stated.
- [V-C (Table II)] The caption and text should note that the manual Bias layout was not created with ANAGEN, as stated in the body, so that the area comparison for Bias-1 is not interpreted as a like-for-like comparison.
Circularity Check
No significant circularity: the R-GCN encoder and RL policy are trained on distinct objectives, and the transfer claims are tested on held-out circuits.
full rationale
The paper's derivation chain is not circular. The R-GCN is pre-trained to predict reward values for floorplans produced by SA/GA/PSO metaheuristics (Section IV-C), but this supervised model is used only as an encoder; the RL agent is trained on true environment rewards defined in Eqs. (4) and (5), not on the R-GCN's reward predictions. The RL policy therefore optimizes the actual metrics (dead space, HPWL, aspect ratio) that are later reported, which is standard objective alignment rather than a fitted-input-called-prediction pattern. The transferability claim is supported by zero-shot and few-shot evaluations on circuits not used during RL training (Table I, grey rows), so the central generalization result is not forced by construction. The paper does rely on the authors' prior work [13] for the base floorplanning pipeline, block-shape generation, and baselines, but that prior work supplies an external comparison and the present contribution, the R-GCN+RL combination with masking and transfer learning, has independent algorithmic content. The abstract's 8.3% area reduction figure appears inconsistent with Table II, where including Bias-1 gives a mean area increase, but numerical inconsistency is a correctness/validity concern, not a circularity of derivation. No step reduces to its own input by definition or by author-imposed uniqueness, and no load-bearing claim is justified solely by a self-citation. Accordingly, the circularity score is 0.
Assumptions & free parameters
free parameters (5)
- Rmax =
11
- Reward weights alpha, beta, gamma =
1, 5, 5
- HPWLmin per circuit =
not disclosed per circuit
- HCL probabilities pcircuit, pconstraint =
0.5, 0.3
- Grid resolution =
32 x 32
assumptions (5)
- domain assumption A circuit can be represented as a graph of functional blocks with connectivity, alignment, and symmetry edges, and node features including a 28-dimensional one-hot encoding of block type.
- domain assumption HPWL and dead space are sufficient proxies for routing quality and area during optimization.
- domain assumption The 21,600 metaheuristic-optimized floorplans used to pre-train the R-GCN are representative of good floorplans across the target circuit families.
- domain assumption An RL agent trained on 3 OTAs and 2 bias circuits (5 circuits total) with hybrid curriculum learning transfers to unseen circuit topologies such as RS latch, driver, and larger bias.
- ad hoc to paper Adding congestion-aware device spacing only to baseline methods produces a fair comparison.
Cite this review
Pith. "Pith review of Effective Analog ICs Floorplanning with Relational Graph Neural Networks and Reinforcement Learning." pith.science (2026). https://pith.science/paper/AXP2BS3H
@misc{pith2026241115212,
author = {Pith},
title = {Pith review of: Effective Analog ICs Floorplanning with Relational Graph Neural Networks and Reinforcement Learning},
year = {2026},
howpublished = {\url{https://pith.science/paper/AXP2BS3H}},
note = {Machine review of arXiv:2411.15212}
}
abstract
Analog integrated circuit (IC) floorplanning is typically a manual process with the placement of components (devices and modules) planned by a layout engineer. This process is further complicated by the interdependence of floorplanning and routing steps, numerous electric and layout-dependent constraints, as well as the high level of customization expected in analog design. This paper presents a novel automatic floorplanning algorithm based on reinforcement learning. It is augmented by a relational graph convolutional neural network model for encoding circuit features and positional constraints. The combination of these two machine learning methods enables knowledge transfer across different circuit designs with distinct topologies and constraints, increasing the \emph{generalization ability} of the solution. Applied to $6$ industrial circuits, our approach surpassed established floorplanning techniques in terms of speed, area and half-perimeter wire length. When integrated into a \emph{procedural generator} for layout completion, overall layout time was reduced by $67.3\%$ with a $8.3\%$ mean area reduction compared to manual layout.
Figures
Figures from the paper (3 more)
Reference graph
Works this paper leans on
-
[16]
A. P. L. de Gusm ˜ao, N. C. Gomes Horta, N. C. Correia Lourenc ¸o, and R. M. Ferreira Martins, “Scalable and order invariant analog integrated circuit placement with Attention-based Graph-to-Sequence deep models,” Expert Systems with Applications , vol. 207, p. 117954, Nov. 2022, publisher: Elsevier Ltd. [Online]. Available: https://linkinghub.elsevier.co...
work page 2022
-
[17]
Analog layout placement for FinFET technol- ogy using reinforcement learning,
M. Ahmadi and L. Zhang, “Analog layout placement for FinFET technol- ogy using reinforcement learning,” in Proceedings - IEEE International Symposium on Circuits and Systems , vol. 2021-May. Institute of Electrical and Electronics Engineers Inc., 2021, iSSN: 02714310
work page 2021
-
[13]
Fast ML-driven Analog Circuit Layout using Reinforcement Learning and Steiner Trees
D. Basso, L. Bortolussi, M. Videnovic-Misic, and H. Habal, “Fast ml-driven analog circuit layout using reinforcement learning and steiner trees,” in 20th Int. Conf. on SMACD , 2024. [Online]. Available: https://arxiv.org/abs/2405.16951
work page Pith review arXiv 2024
-
[1]
A review on vlsi floor- planning optimization using metaheuristic algorithms,
R. B. Singh, A. S. Baghel, and A. Agarwal, “A review on vlsi floor- planning optimization using metaheuristic algorithms,” in 2016 Interna- tional Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT). IEEE, 2016, pp. 4198–4202
work page 2016
-
[2]
A customized graph neural network model for guiding analog IC placement,
Y . Li, Y . Lin, M. Madhusudan, A. Sharma, W. Xu, S. S. Sapatnekar, R. Harjani, and J. Hu, “A customized graph neural network model for guiding analog IC placement,” in Proceedings of the 39th International Conference on Computer-Aided Design , vol. 2020-November. New York, NY , USA: ACM, Nov. 2020, pp. 1–9. [Online]. Available: https://dl.acm.org/doi/10....
arXiv 2020
-
[3]
Reinforcement learning for combinatorial optimization: A survey,
N. Mazyavkina, S. Sviridov, S. Ivanov, and E. Burnaev, “Reinforcement learning for combinatorial optimization: A survey,” Computers & Oper- ations Research, vol. 134, p. 105400, 2021
2021
-
[4]
Maskplace: Fast chip placement via rein- forced visual representation learning,
Y . Lai, Y . Mu, and P. Luo, “Maskplace: Fast chip placement via rein- forced visual representation learning,” Advances in Neural Information Processing Systems, vol. 35, pp. 24 019–24 030, 2022
work page 2022
-
[5]
On joint learning for solving placement and routing in chip design,
R. Cheng and J. Yan, “On joint learning for solving placement and routing in chip design,” in Proceedings of the 35th International Conference on Neural Information Processing Systems , ser. NIPS ’21. Red Hook, NY , USA: Curran Associates Inc., 2024
work page 2024
Show all 31 references
-
[6]
Generalizable Floorplanner through Corner Block List Representation and Hypergraph Embedding,
M. Amini, Z. Zhang, S. Penmetsa, Y . Zhang, J. Hao, and W. Liu, “Generalizable Floorplanner through Corner Block List Representation and Hypergraph Embedding,” in Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining . New York, NY , USA: ACM, Au...
2022
-
[7]
Chipformer: Trans- ferable chip placement via offline decision transformer,
Y . Lai, J. Liu, Z. Tang, B. Wang, J. Hao, and P. Luo, “Chipformer: Trans- ferable chip placement via offline decision transformer,” in International Conference on Machine Learning . PMLR, 2023, pp. 18 346–18 364
2023
-
[8]
Miracle: Multi-action reinforcement learning-based chip floorplanning reasoner,
B. Yang, Q. Xu, H. Geng, S. Chen, and Y . Kang, “Miracle: Multi-action reinforcement learning-based chip floorplanning reasoner,” in 2024 Design, Automation & Test in Europe Conference & Exhibition (DATE) , Mar. 2024, p. 1–6. [Online]. Available: https: //ieeexplore.ieee.org/d...
2024
-
[9]
Modeling relational data with graph convolutional net- works,
M. Schlichtkrull, T. N. Kipf, P. Bloem, R. Van Den Berg, I. Titov, and M. Welling, “Modeling relational data with graph convolutional net- works,” in The semantic web: 15th international conference, ESWC 2018, Heraklion, Crete, Greece, June 3–7, 2018, proceedings 15 . Springer...
2018
-
[10]
An introduction to convolutional neural networks,
K. O’Shea and R. Nash, “An introduction to convolutional neural networks,” 2015. [Online]. Available: https://arxiv.org/abs/1511.08458
2015 arXiv
-
[11]
Anagen: A methodology for analog circuit generation,
F. Passerini, K. Cherniak, F. Renneke, H. Habal, and C. Sandner, “Anagen: A methodology for analog circuit generation,” in IEEE CICC, 2021
2021
-
[12]
A procedural generator for the sizing and physical synthesis of a mosfet low-side driver,
D. Demiri, G. Capodivacca, D. Privato, H. Habal, and F. Renneke, “A procedural generator for the sizing and physical synthesis of a mosfet low-side driver,” in 2023 19th Int. Conf. on SMACD , 2023, pp. 1–4
2023
-
[14]
Symmetry within the sequence-pair representation in the context of placement for analog design,
F. Balasa and K. Lampaert, “Symmetry within the sequence-pair representation in the context of placement for analog design,” IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, vol. 19, no. 7, pp. 721–731, Jul. 2000. [Online]. Available: http://ieeex...
2000
-
[15]
A Novel B*tree Crossover-Based Simulated Annealing Algorithm for Com- binatorial Optimization in VLSI Fixed-Outline Floorplans,
M. Shunmugathammal, C. Christopher Columbus, and S. Anand, “A Novel B*tree Crossover-Based Simulated Annealing Algorithm for Com- binatorial Optimization in VLSI Fixed-Outline Floorplans,” Circuits, Systems, and Signal Processing , vol. 39, no. 2, pp. 900–918, Feb. 2020, publi...
2020
-
[18]
A survey of graph neural networks for electronic design automation,
D. S. Lopera, L. Servadei, G. N. Kiprit, S. Hazra, R. Wille, and W. Ecker, “A survey of graph neural networks for electronic design automation,” in 2021 ACM/IEEE 3rd Workshop on Machine Learning for CAD (MLCAD) . Raleigh, NC, USA: IEEE, Aug. 2021, p. 1–6. [Online]. Available: ...
2021
-
[19]
Neu- ral message passing for quantum chemistry,
J. Gilmer, S. S. Schoenholz, P. F. Riley, O. Vinyals, and G. E. Dahl, “Neu- ral message passing for quantum chemistry,” in International conference on machine learning . PMLR, 2017, pp. 1263–1272
2017
-
[20]
Semi-supervised classification with graph convolutional networks,
T. N. Kipf and M. Welling, “Semi-supervised classification with graph convolutional networks,” in International Conference on Learning Representations, 2017. [Online]. Available: https://openreview.net/forum? id=SJU4ayYgl
2017
-
[21]
Machine learning based structure recognition in analog schematics for constraints generation,
R. Patel, H. Habal, and K. R. Venkata, “Machine learning based structure recognition in analog schematics for constraints generation,” in Design and Verification Conference (DVcon) Europe , Oct. 2021
2021
-
[22]
A graph placement methodology for fast chip design
A. Mirhoseini, A. Goldie, M. Yazgan, J. W. Jiang, E. Songhori, S. Wang, Y .-J. Lee, E. Johnson, O. Pathak, A. Nazi, J. Pak, A. Tong, K. Srinivasa, W. Hang, E. Tuncer, Q. V . Le, J. Laudon, R. Ho, R. Carpenter, and J. Dean, “A graph placement methodology for fast chip design.” ...
2021
-
[23]
Toward Reinforcement Learning-based Rectilinear Macro Placement Under Human Constraints,
T. P. Le, H. T. Nguyen, S. Baek, T. Kim, J. Lee, S. Kim, H. Kim, M. Jung, D. Kim, S. Lee, and D. Choi, “Toward Reinforcement Learning-based Rectilinear Macro Placement Under Human Constraints,” in Fast ML for Science Workshop , 2023. [Online]. Available: https://fastmachinelea...
2023
-
[24]
Prox- imal Policy Optimization Algorithms,
J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov, “Prox- imal Policy Optimization Algorithms,” Aug. 2017, arXiv:1707.06347 [cs]. [Online]. Available: http://arxiv.org/abs/1707.06347
2017 arXiv
-
[25]
A closer look at invalid action masking in policy gradient algorithms,
S. Huang and S. Onta ˜n´on, “A closer look at invalid action masking in policy gradient algorithms,” The International FLAIRS Conference Proceedings, vol. 35, May 2022, arXiv:2006.14171 [cs, stat]. [Online]. Available: http://arxiv.org/abs/2006.14171
2022 arXiv
-
[26]
Learning to Execute,
W. Zaremba and I. Sutskever, “Learning to Execute,” Feb. 2015, arXiv:1410.4615 [cs]. [Online]. Available: http://arxiv.org/abs/1410.4615
2015 arXiv
-
[27]
Magical: An open- source fully automated analog ic layout system from netlist to gdsii,
H. Chen, M. Liu, B. Xu, K. Zhu, X. Tang, S. Li, Y . Lin, N. Sun, and D. Z. Pan, “Magical: An open- source fully automated analog ic layout system from netlist to gdsii,” IEEE Design & Test, vol. 38, no. 2, p. 19–26, Apr
-
[28]
Align: A system for automating analog layout,
T. Dhar, K. Kunal, Y . Li, M. Madhusudan, J. Poojary, A. K. Sharma, W. Xu, S. M. Burns, R. Harjani, J. Hu et al. , “Align: A system for automating analog layout,” IEEE Design & Test, vol. 38, no. 2, pp. 8–18, 2020
2020
-
[29]
Deep graph library: A graph-centric, highly-performant package for graph neural networks,
M. Wang, D. Zheng, Z. Ye, Q. Gan, M. Li, X. Song, J. Zhou, C. Ma, L. Yu, Y . Gai, T. Xiao, T. He, G. Karypis, J. Li, and Z. Zhang, “Deep graph library: A graph-centric, highly-performant package for graph neural networks,” 2020. [Online]. Available: https://arxiv.org/abs/1909.01315
2020 arXiv
-
[30]
Stable-baselines3: Reliable reinforcement learning implementations,
A. Raffin, A. Hill, A. Gleave, A. Kanervisto, M. Ernestus, and N. Dormann, “Stable-baselines3: Reliable reinforcement learning implementations,” Journal of Machine Learning Research , vol. 22, no. 268, pp. 1–8, 2021. [Online]. Available: http://jmlr.org/papers/v22/ 20-1364.html
2021
-
[2021]
Available: https://ieeexplore.ieee.org/document/9195880/
[Online]. Available: https://ieeexplore.ieee.org/document/9195880/
Reviewed August 12, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.