Pith. sign in

REVIEW 4 major objections 5 minor 31 references

Effective Analog ICs Floorplanning with Relational Graph Neural Networks and Reinforcement Learning

T0 review · 4 major / 5 minor · reviewed 2026-08-12 · deepseek-v4-flash

Pith's one-line read An RL agent augmented by a pre-trained relational graph network can floorplan industrial analog circuits faster and with less area than established metaheuristics and, in many cases, than manual engineers.

desk verdict Solid RL/GNN analog floorplanner with real industrial tests, but the abstract's headline area and time reductions cherry-pick the layouts that improved. read the letter →

arxiv 2411.15212 v1 pith:AXP2BS3H submitted 2024-11-20 cs.LG cs.AIcs.SYeess.SY

classification cs.LGcs.AIcs.SYeess.SY
keywords analogICfloorplanningreinforcementlearningrelationalgraphconvolutionalnetworksphysicaldesigntransferprocedurallayoutgenerationhalf-perimeterwirelength
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper tries to show that analog IC floorplanning, normally a manual, expert-driven step with many layout-dependent constraints, can be automated by an RL agent that reads circuit structure through a pre-trained relational graph convolutional network. The authors claim that pre-training the graph encoder on rewards from metaheuristic floorplans gives the agent transferable knowledge, so one policy can place blocks for several different analog circuits, including ones never seen in training. If true, this matters because analog layout is a bottleneck in chip design: the paper reports a 67.3% reduction in overall layout time and an 8.3% mean area reduction against manual layout on industrial circuits.

What carries the argument

The load-bearing object is the pre-trained R-GCN encoder: a relational graph convolutional network that consumes a heterogeneous graph of the circuit, where nodes are functional blocks or devices with features like area and a one-hot functional-type code, and edges are connectivity, alignment or symmetry relations. It is trained (after removing its fully-connected heads) on 21,600 floorplans produced by SA, GA, and PSO to predict their reward; the resulting embeddings are then fed to the RL agent alongside CNN-encoded masks (current grid, proxy wirelength increase, empty-space increase, and shape-specific placement masks). The paper's contribution is the claim that this reward-aligned graph representation is what lets the same RL policy transfer across distinct circuit topologies and constraints.

What would settle it

Take a circuit whose functional blocks (or their combinations) do not appear in the R-GCN pre-training set, run the zero-shot agent on it, and compare against a version of the same agent whose R-GCN encoder was randomly initialized instead of pre-trained; if the pre-trained encoder does not improve reward, area, or HPWL, or if the zero-shot floorplan violates symmetry or overlap constraints, the central transfer claim is unsupported.

Watch

Extended reading notes

Core claim

The central claim, in the authors' own terms, is that a hybrid R-GCN and RL system produces better analog floorplans than established metaheuristics and prior RL methods. The R-GCN is pre-trained to predict a placement reward for a circuit graph; its frozen encoder then supplies node and graph embeddings to a PPO agent that places functional blocks on a 32x32 grid, using action masks to enforce symmetry, alignment and non-overlap. With hybrid curriculum training on five circuits, the agent is claimed to generalize zero-shot to three unseen circuits, and to beat SA, GA, PSO and earlier RL baselines on reward, HPWL, dead space or runtime after a short fine-tuning. Integrated with the ANAGEN procedural generator and OARSMT global routing, the method reportedly yields complete DRC/LVS-clean layouts of the same quality as manual design in hours instead of days.

Load-bearing premise

The whole transfer story rests on the assumption that the R-GCN encoder, pre-trained on floorplans generated by metaheuristics for a specific set of analog circuit families, learns a representation of circuit structure that transfers to arbitrary new circuits; if the training set or the one-hot functional encoding misses what matters for a novel circuit, the zero-shot and few-shot gains disappear.

Editorial extensions

If this is right

  • One policy, once trained on a few circuits, can be re-used across an analog design library; per-circuit optimization time drops from hours of metaheuristic search to seconds of inference.
  • Because the agent outputs routing-ready floorplans without congestion estimation, the downstream global router can be simpler and the whole layout pipeline shorter.
  • The method's action masking makes constraint satisfaction (symmetry, alignment, non-overlap) a property of the policy, reducing the need for post-generation checking and repair.
  • In combination with ANAGEN, an engineer can go from netlist to DRC/LVS-clean layout of a simple block in a fraction of the manual time, making early design iterations cheaper.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The architecture decouples the expensive part (pre-training the graph encoder on 21,600 metaheuristic floorplans) from the per-circuit cost (seconds of RL inference), so the economics improve as the encoder is reused across more designs, but only if the pre-training distribution stays representative.
  • Since the R-GCN is trained on reward labels from metaheuristics, the same scaffolding could be pointed at different objectives such as routability, current density, or thermal gradients by swapping the reward oracle, yielding transferable encoders for other physical-design decisions.
  • A cheaper curriculum or a smaller pre-training set might give the same transfer, but the paper does not ablate that; benchmarking the sample complexity of the encoder pre-training would tell an industrial team where to spend compute.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. The paper proposes a floorplanning method for analog ICs that combines a relational graph convolutional network (R-GCN) encoder with a reinforcement learning (RL) agent. The R-GCN is pre-trained to predict floorplan rewards and then used as a graph-embedding module; a CNN processes grid masks; a masked PPO agent selects shapes and grid positions for circuit blocks. The method is evaluated on six industrial circuits against SA, GA, PSO, and two prior RL-based methods, with zero-shot and few-shot fine-tuning. The authors also integrate the floorplanner into the ANAGEN procedural layout generator and compare three completed layouts against manual layouts, reporting a 67.3% layout-time reduction and an 8.3% mean area reduction.

Significance. If substantiated, the work would demonstrate a practical RL-based analog floorplanning system with transfer across circuit topologies, tested on industrial designs. The paper includes a substantial training setup (21,600 pre-training floorplans, 12.7 hours of RL training) and a clear MDP formulation with action masking. However, the central quantitative claims in the abstract are not reproducible from the reported tables, the baseline comparison may favor the proposed method through asymmetric congestion-aware spacing, and the contribution of the R-GCN is not isolated via ablation. These issues prevent the results from being taken at face value.

major comments (4)
  1. [V-C (Table II) and Abstract] The abstract claims an 8.3% mean area reduction compared to manual layout, but Table II reports area changes of -14.1%, +52.1%, and -2.43% for OTA, Bias-1, and Driver, respectively. The mean across all three circuits is +11.9%, i.e., an area increase, not a reduction. The -8.3% value corresponds to averaging only OTA and Driver, excluding Bias-1; the exclusion is mentioned in Section V-C but not in the abstract. Similarly, the claimed 67.3% overall layout-time reduction is not derivable from Table II under any clearly stated aggregation rule: including the manual improvement time for the Driver circuit yields an automated total that exceeds the manual layout time. The authors must state the exact aggregation and the Bias-1 caveat in the abstract, or revise the claims to match the data.
  2. [V-B (Table I)] The statement "For a fair comparison, congestion-aware device spacing is applied to all other approaches" creates an asymmetry: the proposed method's floorplans are measured without this spacing, while all baselines have it. Since Table I reports floorplan metrics (dead space, HPWL) before routing, this inflates the baselines' dead space and biases the comparison in favor of the proposed method. To support the fairness claim, the authors should either apply the same congestion-aware spacing to the proposed method in Table I, or demonstrate that the proposed floorplans are routable without extra spacing for all six evaluated circuits, not only for the three in Table II.
  3. [IV-C, IV-D] The paper attributes the generalization ability of the approach to the R-GCN encoder, but no ablation is provided in which the RL agent is trained without the R-GCN (e.g., using only the CNN masks and grid features). The comparison with the RL method from [13] is not an adequate control because that prior work uses a different sequence-pair representation and does not share the same architecture. Without such an ablation, the specific contribution of the R-GCN to the reported rewards and transferability is not established. Additionally, no prediction accuracy of the pre-trained R-GCN reward model is reported, so it is unclear whether the encoder actually learns meaningful circuit features.
  4. [V-B (Table I)] The text claims the method "surpasses established floorplanning techniques in terms of speed, area and half-perimeter wire length" for the six circuits, but Table I does not report area; it reports dead space, HPWL, and reward. The reward is the training objective of the proposed agent (Eq. 5), so comparing rewards alone is not an independent evaluation. Area is reported only for the three circuits in Table II, which cannot support a six-circuit area claim. Please report area for all evaluated circuits in Table I or qualify the claim to dead space and HPWL.
minor comments (5)
  1. [Abstract and V-C] The abstract states "Applied to 6 industrial circuits..." but the 67.3% time and 8.3% area reductions appear to refer only to the three circuits in Table II. Clarify that the manual-layout comparison is on a subset of three circuits.
  2. [IV-C] The composition of the 21,600 pre-training floorplans is not described (e.g., number of circuits per type, distribution of constrained vs. unconstrained cases, and how rewards were computed). This information is needed to assess the source of the R-GCN's transferability.
  3. [V-B (Table I)] The terms "1-shot", "100-shot", and "1000-shot" are not defined; specify whether they denote the number of fine-tuning episodes, gradient steps, or something else.
  4. [IV-D5] The hybrid curriculum learning schedule is described only by the probabilities pcircuit and pconstraint; the order in which circuits of increasing complexity are introduced and the criterion for "growing complexity" should be stated.
  5. [V-C (Table II)] The caption and text should note that the manual Bias layout was not created with ANAGEN, as stated in the body, so that the area comparison for Bias-1 is not interpreted as a like-for-like comparison.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the R-GCN encoder and RL policy are trained on distinct objectives, and the transfer claims are tested on held-out circuits.

full rationale

The paper's derivation chain is not circular. The R-GCN is pre-trained to predict reward values for floorplans produced by SA/GA/PSO metaheuristics (Section IV-C), but this supervised model is used only as an encoder; the RL agent is trained on true environment rewards defined in Eqs. (4) and (5), not on the R-GCN's reward predictions. The RL policy therefore optimizes the actual metrics (dead space, HPWL, aspect ratio) that are later reported, which is standard objective alignment rather than a fitted-input-called-prediction pattern. The transferability claim is supported by zero-shot and few-shot evaluations on circuits not used during RL training (Table I, grey rows), so the central generalization result is not forced by construction. The paper does rely on the authors' prior work [13] for the base floorplanning pipeline, block-shape generation, and baselines, but that prior work supplies an external comparison and the present contribution, the R-GCN+RL combination with masking and transfer learning, has independent algorithmic content. The abstract's 8.3% area reduction figure appears inconsistent with Table II, where including Bias-1 gives a mean area increase, but numerical inconsistency is a correctness/validity concern, not a circularity of derivation. No step reduces to its own input by definition or by author-imposed uniqueness, and no load-bearing claim is justified solely by a self-citation. Accordingly, the circularity score is 0.

Assumptions & free parameters 5 free parameters · 5 assumptions · 0 invented entities

The method introduces no new physical entities. It does depend on several hand-chosen parameters (Rmax, reward weights, grid size, curriculum probabilities) and on domain assumptions about the sufficiency of graph encodings and proxy metrics. The most consequential free parameter is HPWLmin, which is computed per circuit via metaheuristics and enters the reward definition.

free parameters (5)
  • Rmax = 11
    Empirically derived maximum aspect ratio used to set grid dimensions W = H = sqrt(sum(A_i)/Rmax) (Section IV-D1). It controls grid scale and discretization; a wrong value would distort placements.
  • Reward weights alpha, beta, gamma = 1, 5, 5
    Set empirically 'through extensive experimentation' (Section IV-D4) to balance area, HPWL, and aspect ratio error in the final reward. These choices define what 'optimal' means.
  • HPWLmin per circuit = not disclosed per circuit
    Minimum HPWL estimated through a metaheuristic-based simulation and used to normalize HPWL in the end-of-episode reward (Section IV-D4). Each new circuit would need a metaheuristic run to compute this value.
  • HCL probabilities pcircuit, pconstraint = 0.5, 0.3
    Sampling probabilities for new circuits and constraints during curriculum training (Section V-A). These affect generalization but are hyperparameters.
  • Grid resolution = 32 x 32
    Discretization of the layout canvas chosen to balance action space size and accuracy (Section IV-D1). Not fitted, but a design choice that affects all results.
assumptions (5)
  • domain assumption A circuit can be represented as a graph of functional blocks with connectivity, alignment, and symmetry edges, and node features including a 28-dimensional one-hot encoding of block type.
    Section IV-C: this representation is the input to the R-GCN; if it misses important constraints, the embeddings cannot guide the RL agent.
  • domain assumption HPWL and dead space are sufficient proxies for routing quality and area during optimization.
    The reward is a weighted sum of area, HPWL, and aspect ratio error (Section IV-D4); no parasitic or DRC information enters the reward.
  • domain assumption The 21,600 metaheuristic-optimized floorplans used to pre-train the R-GCN are representative of good floorplans across the target circuit families.
    Section IV-C: the R-GCN learns reward predictions from these labels; biased or non-representative training data would produce misleading embeddings.
  • domain assumption An RL agent trained on 3 OTAs and 2 bias circuits (5 circuits total) with hybrid curriculum learning transfers to unseen circuit topologies such as RS latch, driver, and larger bias.
    Section IV-D5 and V-B: this transfer is the central generalization claim, but the training set is small and a subset of the test set.
  • ad hoc to paper Adding congestion-aware device spacing only to baseline methods produces a fair comparison.
    Section V-B: the baselines are penalized with extra spacing while the proposed method is not, which advantages the proposed method in dead space and HPWL metrics.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Effective Analog ICs Floorplanning with Relational Graph Neural Networks and Reinforcement Learning." pith.science (2026). https://pith.science/paper/AXP2BS3H

@misc{pith2026241115212,
  author       = {Pith},
  title        = {Pith review of: Effective Analog ICs Floorplanning with Relational Graph Neural Networks and Reinforcement Learning},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/AXP2BS3H}},
  note         = {Machine review of arXiv:2411.15212}
}
abstract

Analog integrated circuit (IC) floorplanning is typically a manual process with the placement of components (devices and modules) planned by a layout engineer. This process is further complicated by the interdependence of floorplanning and routing steps, numerous electric and layout-dependent constraints, as well as the high level of customization expected in analog design. This paper presents a novel automatic floorplanning algorithm based on reinforcement learning. It is augmented by a relational graph convolutional neural network model for encoding circuit features and positional constraints. The combination of these two machine learning methods enables knowledge transfer across different circuit designs with distinct topologies and constraints, increasing the \emph{generalization ability} of the solution. Applied to $6$ industrial circuits, our approach surpassed established floorplanning techniques in terms of speed, area and half-perimeter wire length. When integrated into a \emph{procedural generator} for layout completion, overall layout time was reduced by $67.3\%$ with a $8.3\%$ mean area reduction compared to manual layout.

Figures

Figures reproduced from arXiv: 2411.15212 by the authors.

Figure 1
Figure 1. Overview of the automatic layout pipeline. [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 3
Figure 3. R-GCN architecture for circuit reward prediction. [PITH_FULL_IMAGE:figures/full_fig_p003_3.png] view at source ↗
Figure 4
Figure 4. Overview of the RL model, enriched with CNN based feature extractor and policy network. [PITH_FULL_IMAGE:figures/full_fig_p004_4.png] view at source ↗
Figures from the paper (3 more)
Figure 5
Figure 5. Figure 5: Dead space (left) and wire (right) masks. Darker areas highlight higher [PITH_FULL_IMAGE:figures/full_fig_p004_5.png]
Figure 6
Figure 6. Figure 6: Episode Reward Mean and Approximate Kullback-Leibler divergence [PITH_FULL_IMAGE:figures/full_fig_p005_6.png]
Figure 7
Figure 7. Figure 7: (a) RL-generated placement and OARSMT global routing, (b) post [PITH_FULL_IMAGE:figures/full_fig_p006_7.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

31 extracted references · 22 canonical work pages

  1. [16]

    Scalable and order invariant analog integrated circuit placement with Attention-based Graph-to-Sequence deep models,

    A. P. L. de Gusm ˜ao, N. C. Gomes Horta, N. C. Correia Lourenc ¸o, and R. M. Ferreira Martins, “Scalable and order invariant analog integrated circuit placement with Attention-based Graph-to-Sequence deep models,” Expert Systems with Applications , vol. 207, p. 117954, Nov. 2022, publisher: Elsevier Ltd. [Online]. Available: https://linkinghub.elsevier.co...

  2. [17]

    Analog layout placement for FinFET technol- ogy using reinforcement learning,

    M. Ahmadi and L. Zhang, “Analog layout placement for FinFET technol- ogy using reinforcement learning,” in Proceedings - IEEE International Symposium on Circuits and Systems , vol. 2021-May. Institute of Electrical and Electronics Engineers Inc., 2021, iSSN: 02714310

  3. [13]

    Fast ML-driven Analog Circuit Layout using Reinforcement Learning and Steiner Trees

    D. Basso, L. Bortolussi, M. Videnovic-Misic, and H. Habal, “Fast ml-driven analog circuit layout using reinforcement learning and steiner trees,” in 20th Int. Conf. on SMACD , 2024. [Online]. Available: https://arxiv.org/abs/2405.16951

  4. [1]

    A review on vlsi floor- planning optimization using metaheuristic algorithms,

    R. B. Singh, A. S. Baghel, and A. Agarwal, “A review on vlsi floor- planning optimization using metaheuristic algorithms,” in 2016 Interna- tional Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT). IEEE, 2016, pp. 4198–4202

  5. [2]

    A customized graph neural network model for guiding analog IC placement,

    Y . Li, Y . Lin, M. Madhusudan, A. Sharma, W. Xu, S. S. Sapatnekar, R. Harjani, and J. Hu, “A customized graph neural network model for guiding analog IC placement,” in Proceedings of the 39th International Conference on Computer-Aided Design , vol. 2020-November. New York, NY , USA: ACM, Nov. 2020, pp. 1–9. [Online]. Available: https://dl.acm.org/doi/10....

  6. [3]

    Reinforcement learning for combinatorial optimization: A survey,

    N. Mazyavkina, S. Sviridov, S. Ivanov, and E. Burnaev, “Reinforcement learning for combinatorial optimization: A survey,” Computers & Oper- ations Research, vol. 134, p. 105400, 2021

  7. [4]

    Maskplace: Fast chip placement via rein- forced visual representation learning,

    Y . Lai, Y . Mu, and P. Luo, “Maskplace: Fast chip placement via rein- forced visual representation learning,” Advances in Neural Information Processing Systems, vol. 35, pp. 24 019–24 030, 2022

  8. [5]

    On joint learning for solving placement and routing in chip design,

    R. Cheng and J. Yan, “On joint learning for solving placement and routing in chip design,” in Proceedings of the 35th International Conference on Neural Information Processing Systems , ser. NIPS ’21. Red Hook, NY , USA: Curran Associates Inc., 2024

Show all 31 references
  1. [6]

    Generalizable Floorplanner through Corner Block List Representation and Hypergraph Embedding,

    M. Amini, Z. Zhang, S. Penmetsa, Y . Zhang, J. Hao, and W. Liu, “Generalizable Floorplanner through Corner Block List Representation and Hypergraph Embedding,” in Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining . New York, NY , USA: ACM, Au...

  2. [7]

    Chipformer: Trans- ferable chip placement via offline decision transformer,

    Y . Lai, J. Liu, Z. Tang, B. Wang, J. Hao, and P. Luo, “Chipformer: Trans- ferable chip placement via offline decision transformer,” in International Conference on Machine Learning . PMLR, 2023, pp. 18 346–18 364

  3. [8]

    Miracle: Multi-action reinforcement learning-based chip floorplanning reasoner,

    B. Yang, Q. Xu, H. Geng, S. Chen, and Y . Kang, “Miracle: Multi-action reinforcement learning-based chip floorplanning reasoner,” in 2024 Design, Automation & Test in Europe Conference & Exhibition (DATE) , Mar. 2024, p. 1–6. [Online]. Available: https: //ieeexplore.ieee.org/d...

  4. [9]

    Modeling relational data with graph convolutional net- works,

    M. Schlichtkrull, T. N. Kipf, P. Bloem, R. Van Den Berg, I. Titov, and M. Welling, “Modeling relational data with graph convolutional net- works,” in The semantic web: 15th international conference, ESWC 2018, Heraklion, Crete, Greece, June 3–7, 2018, proceedings 15 . Springer...

  5. [10]

    An introduction to convolutional neural networks,

    K. O’Shea and R. Nash, “An introduction to convolutional neural networks,” 2015. [Online]. Available: https://arxiv.org/abs/1511.08458

  6. [11]

    Anagen: A methodology for analog circuit generation,

    F. Passerini, K. Cherniak, F. Renneke, H. Habal, and C. Sandner, “Anagen: A methodology for analog circuit generation,” in IEEE CICC, 2021

  7. [12]

    A procedural generator for the sizing and physical synthesis of a mosfet low-side driver,

    D. Demiri, G. Capodivacca, D. Privato, H. Habal, and F. Renneke, “A procedural generator for the sizing and physical synthesis of a mosfet low-side driver,” in 2023 19th Int. Conf. on SMACD , 2023, pp. 1–4

  8. [14]

    Symmetry within the sequence-pair representation in the context of placement for analog design,

    F. Balasa and K. Lampaert, “Symmetry within the sequence-pair representation in the context of placement for analog design,” IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, vol. 19, no. 7, pp. 721–731, Jul. 2000. [Online]. Available: http://ieeex...

  9. [15]

    A Novel B*tree Crossover-Based Simulated Annealing Algorithm for Com- binatorial Optimization in VLSI Fixed-Outline Floorplans,

    M. Shunmugathammal, C. Christopher Columbus, and S. Anand, “A Novel B*tree Crossover-Based Simulated Annealing Algorithm for Com- binatorial Optimization in VLSI Fixed-Outline Floorplans,” Circuits, Systems, and Signal Processing , vol. 39, no. 2, pp. 900–918, Feb. 2020, publi...

  10. [18]

    A survey of graph neural networks for electronic design automation,

    D. S. Lopera, L. Servadei, G. N. Kiprit, S. Hazra, R. Wille, and W. Ecker, “A survey of graph neural networks for electronic design automation,” in 2021 ACM/IEEE 3rd Workshop on Machine Learning for CAD (MLCAD) . Raleigh, NC, USA: IEEE, Aug. 2021, p. 1–6. [Online]. Available: ...

  11. [19]

    Neu- ral message passing for quantum chemistry,

    J. Gilmer, S. S. Schoenholz, P. F. Riley, O. Vinyals, and G. E. Dahl, “Neu- ral message passing for quantum chemistry,” in International conference on machine learning . PMLR, 2017, pp. 1263–1272

  12. [20]

    Semi-supervised classification with graph convolutional networks,

    T. N. Kipf and M. Welling, “Semi-supervised classification with graph convolutional networks,” in International Conference on Learning Representations, 2017. [Online]. Available: https://openreview.net/forum? id=SJU4ayYgl

  13. [21]

    Machine learning based structure recognition in analog schematics for constraints generation,

    R. Patel, H. Habal, and K. R. Venkata, “Machine learning based structure recognition in analog schematics for constraints generation,” in Design and Verification Conference (DVcon) Europe , Oct. 2021

  14. [22]

    A graph placement methodology for fast chip design

    A. Mirhoseini, A. Goldie, M. Yazgan, J. W. Jiang, E. Songhori, S. Wang, Y .-J. Lee, E. Johnson, O. Pathak, A. Nazi, J. Pak, A. Tong, K. Srinivasa, W. Hang, E. Tuncer, Q. V . Le, J. Laudon, R. Ho, R. Carpenter, and J. Dean, “A graph placement methodology for fast chip design.” ...

  15. [23]

    Toward Reinforcement Learning-based Rectilinear Macro Placement Under Human Constraints,

    T. P. Le, H. T. Nguyen, S. Baek, T. Kim, J. Lee, S. Kim, H. Kim, M. Jung, D. Kim, S. Lee, and D. Choi, “Toward Reinforcement Learning-based Rectilinear Macro Placement Under Human Constraints,” in Fast ML for Science Workshop , 2023. [Online]. Available: https://fastmachinelea...

  16. [24]

    Prox- imal Policy Optimization Algorithms,

    J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov, “Prox- imal Policy Optimization Algorithms,” Aug. 2017, arXiv:1707.06347 [cs]. [Online]. Available: http://arxiv.org/abs/1707.06347

  17. [25]

    A closer look at invalid action masking in policy gradient algorithms,

    S. Huang and S. Onta ˜n´on, “A closer look at invalid action masking in policy gradient algorithms,” The International FLAIRS Conference Proceedings, vol. 35, May 2022, arXiv:2006.14171 [cs, stat]. [Online]. Available: http://arxiv.org/abs/2006.14171

  18. [26]

    Learning to Execute,

    W. Zaremba and I. Sutskever, “Learning to Execute,” Feb. 2015, arXiv:1410.4615 [cs]. [Online]. Available: http://arxiv.org/abs/1410.4615

  19. [27]

    Magical: An open- source fully automated analog ic layout system from netlist to gdsii,

    H. Chen, M. Liu, B. Xu, K. Zhu, X. Tang, S. Li, Y . Lin, N. Sun, and D. Z. Pan, “Magical: An open- source fully automated analog ic layout system from netlist to gdsii,” IEEE Design & Test, vol. 38, no. 2, p. 19–26, Apr

  20. [28]

    Align: A system for automating analog layout,

    T. Dhar, K. Kunal, Y . Li, M. Madhusudan, J. Poojary, A. K. Sharma, W. Xu, S. M. Burns, R. Harjani, J. Hu et al. , “Align: A system for automating analog layout,” IEEE Design & Test, vol. 38, no. 2, pp. 8–18, 2020

  21. [29]

    Deep graph library: A graph-centric, highly-performant package for graph neural networks,

    M. Wang, D. Zheng, Z. Ye, Q. Gan, M. Li, X. Song, J. Zhou, C. Ma, L. Yu, Y . Gai, T. Xiao, T. He, G. Karypis, J. Li, and Z. Zhang, “Deep graph library: A graph-centric, highly-performant package for graph neural networks,” 2020. [Online]. Available: https://arxiv.org/abs/1909.01315

  22. [30]

    Stable-baselines3: Reliable reinforcement learning implementations,

    A. Raffin, A. Hill, A. Gleave, A. Kanervisto, M. Ernestus, and N. Dormann, “Stable-baselines3: Reliable reinforcement learning implementations,” Journal of Machine Learning Research , vol. 22, no. 268, pp. 1–8, 2021. [Online]. Available: http://jmlr.org/papers/v22/ 20-1364.html

  23. [2021]

    Available: https://ieeexplore.ieee.org/document/9195880/

    [Online]. Available: https://ieeexplore.ieee.org/document/9195880/

Pith tools

Reviewed August 12, 2026 · model on record in the stance chip above.