REVIEW 4 major objections 5 minor 1 cited by
Schemato -- An LLM for Netlist-to-Schematic Conversion
T0 review · 4 major / 5 minor · reviewed 2026-08-12 · deepseek-v4-flash
Pith's one-line read A fine-tuned 8-billion-parameter LLM converts circuit netlists into compilable LTSpice schematics, beating GPT-4o.
desk verdict A plausible first LLM netlist-to-schematic converter, modestly new and honestly reported, but the headline numbers are weakened by test-set selection and the evaluation never touches ML-generated netlists. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The machinery is instruction fine-tuning of an 8-billion-parameter language model on paired netlist and .asc data, where the schematic file is treated as the model's target translation. Prompt design carries part of the load: one prompt variant tells the model to begin with 'Version 4' and a SHEET line carrying the reference schematic's sheet size, and that single addition has a large effect on visual similarity in the fine-tuned models. Data augmentation randomly shuffles the order of SYMBOL/SYMATTR lines so the model learns that line ordering is irrelevant to the circuit. The evaluation stack -- graph edit distance for connectivity, SSIM for visual similarity, compilation success rate for syntax, and BLEU for text fidelity -- determines which prompt and training epoch become Schemato.
What would settle it
Run Schemato on a batch of netlists produced by an ML-based circuit generator, not derived from human schematics, and measure its compilation success rate and CSR-scaled GED and MSSIM; if those numbers fall back to pretrained-LLM levels, the claim that Schemato is ready for ML-generated designs would be contradicted.
Extended reading notes
Core claim
The central claim is that netlist-to-schematic conversion can be treated as a text-to-text translation task and solved by supervised fine-tuning of a general LLM, without heuristic layout rules, topology-specific templates, or an explicit aesthetic measure. Schemato starts from the Llama-3.1-8B instruct model and is trained on roughly 45,000 netlist-to-.asc pairs derived from human-drawn LTSpice schematics. On a held-out test set of 117 circuits, it reaches a 76.07% compilation success rate, compared with 63.25% for the best pretrained baseline, and its compilation-scaled average graph-edit-distance score and mean-structural-similarity score are 0.27 and 0.17, 1.8x and 4.3x the best pretrained values. The paper takes this as evidence that a fine-tuned LLM can output schematics that are syntactically valid, topologically faithful, and visually closer to the human reference than any pretrained model.
Load-bearing premise
The load-bearing premise is that netlists extracted from human-drawn LTSpice schematics are representative of the netlists that machine-learning circuit generators will hand to Schemato, because the training and test sets contain only human-drawn examples while the motivation is ML-generated designs.
Editorial extensions
If this is right
- A designer working with an ML-generated netlist could receive a compilable LTSpice schematic instead of having to draw one by hand, making human review of ML-designed analog circuits practical.
- Because the conversion is framed as translation and the model is fine-tuned on many topologies, the same trained model applies to diverse circuit types without per-topology templates.
- The gap in compilation success between fine-tuned and pretrained models shows that most of the improvement comes from task-specific training, not from stronger base-model reasoning.
- The approach extends to other text-based schematic formats, since the learning procedure does not depend on LTSpice-specific syntax beyond the training data.
Reading between the lines
- The obvious untested scenario is a netlist produced by an ML circuit generator; the dataset contains only human-drawn schematics, so distribution shift in component naming, scale, or topology could lower the reported 76.07% CSR.
- The paper's own analysis shows that more than half of the training samples contain components seen fewer than ten times, suggesting that rare component geometry is a hidden bottleneck and that a larger or more constrained component library would push reliable conversion beyond five-component circuits.
- Since GED and MSSIM measure different things, a practical deployment could combine Schemato with a deterministic placement pass to fix geometric layout while keeping the model's topological correctness.
- The same fine-tuning recipe could be used to learn a specific designer's layout style by training on that designer's own schematics, turning the model into a personalized drafting aid.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces Schemato, a fine-tuned Llama-3.1-8B model that converts SPICE netlists into LTSpice .asc schematic files. The authors create a training set from publicly available LTSpice schematics, preprocess and augment it, and evaluate Schemato against pretrained Llama-3.1-8B and GPT-4o on 117 filtered circuits from the Circuits-LTSpice repository. Using four metrics (GED score, MSSIM, compilation success rate, and BLEU), the paper reports that Schemato achieves 76% CSR and higher GED/MSSIM scores scaled by CSR than the best pretrained models (1.8x and 4.3x, respectively). The paper concludes that Schemato can generate interpretable schematics from netlists and discusses limitations related to component familiarity and circuit size.
Significance. If the reported results hold, the paper presents a potentially useful application of LLMs to an underexplored EDA task: translating netlists into human-readable schematic files. The systematic comparison of prompting strategies, the construction of a curated training set, and the use of multiple evaluation metrics are strengths. However, the paper's central claim—that Schemato supports interpretation of ML-generated netlists—is not directly tested, and the evaluation methodology has load-bearing weaknesses (test-set-based model selection, no confidence intervals, metric computation on compilable outputs only) that affect the reliability of the quantitative claims. The contribution is timely given growing interest in LLMs for analog circuit design, but the evidence as presented is not yet conclusive.
major comments (4)
- [Sec. V, Figs. 4-5] The final model is selected using test-set metrics: the prompt variant is chosen based on Table I results, and the fine-tuning epoch (epoch 6) is chosen because it 'demonstrated the best combination of scores in Fig. 4 and Fig. 5,' where both figures are computed on the test set. This means the reported test performance is the result of selecting the best model on the same 117 circuits, which inflates the apparent advantage over baselines and makes the exact margins (1.8x, 4.3x, 76% vs 63%) unreliable. The authors should use the validation set for all model-selection decisions and report test performance only for the final selected model.
- [Sec. I, Sec. IV-A] The motivating use case is translating ML-generated netlists into schematics, yet the evaluation uses only netlists derived from human-drawn LTSpice schematics (Circuits-LTSpice). The preprocessing in Sec. IV-A removes .lib/.model lines, renames components, and normalizes coordinates, so the resulting netlists are in a simplified format that may not match the output of ML circuit generators, which often emit subcircuits, non-default symbols, or arbitrary naming. No experiment uses netlists from an ML-based generator, so distribution shift in naming, topology, and scale is unmeasured. The paper's own conclusion (Sec. VI) states that Schemato 'cannot generate schematics containing less familiar or unfamiliar components,' which further limits the generality of the practical-utility claim. The authors should either evaluate on ML-generated netlists or explicitly restrict their claims to the tested distribution.
- [Sec. IV-D, Table I] The GED and MSSIM scores are computed only for compilable outputs, and the headline numbers are 'scaled by CSR' (raw score multiplied by CSR). This composite is a nonstandard heuristic: multiplying a quality score by a compilation rate conflates syntactic correctness with structural/visual similarity, and the direction of the bias is unclear. For example, a model that compiles only easy circuits could obtain a high raw score, while a model that compiles many hard circuits could obtain a lower raw score despite better overall performance. The paper does not report confidence intervals for any metric, which is especially problematic given the small test set (117 circuits). The authors should report raw scores on compilable outputs, provide confidence intervals or error bars, and justify the use of CSR-scaled scores as a primary comparison.
- [Sec. VI] The limitations section explicitly acknowledges that over half of the training samples (5,227 of 9,907) contain components appearing fewer than 10 times, and that the model struggles with larger circuits and unfamiliar components. These limitations are central to the claimed generalization: the test set is small and composed of 'generic components,' so the favorable results do not establish that Schemato would succeed on the diverse, large, or ML-generated netlists that the introduction motivates. The paper should either provide evidence on such challenging inputs or temper the abstract's claim that Schemato demonstrates 'the potential of Schemato in reliably generating human-intuitive schematics from netlists' to the specific evaluated setting.
minor comments (5)
- [Abstract] The phrase 'average graph edit distance score and mean structural similarity index measure, scaled by the compilation success rate that are 1.8x and 4.3x higher' is grammatically awkward and could be misread as comparing raw scores; it should clearly state that the comparison is on CSR-scaled scores.
- [Fig. 3] The caption says 'Validations losses are computed after every training epoch,' but the figure shows training and validation loss curves; consider labeling the curves explicitly and correcting the typo 'Validations' to 'Validation'.
- [Sec. IV-C] The sentence 'The number of weight updates per epoch is: Ntrain/(Niter*N_GPU*N_batch) = 44,995/(8*8*1) ≈ 703' is missing a division sign in the text; the equation is clear but should be typeset correctly.
- [Sec. IV-A] The preprocessing description states 'Remove the lines starting with *, TEXT, RECTANGLE, WINDOW, LINE, and CIRCLE.' It would be helpful to clarify whether this includes lines starting with a semicolon or other comment markers used in SPICE netlists.
- [References] Reference [24] has a typo: 'https//github.com/pytorch/torchtune' is missing a colon after 'https'.
Circularity Check
No significant circularity: the core result is standard supervised fine-tuning with an independent held-out test set; test-set model selection is a leakage concern, not a definitional circularity.
full rationale
Schemato is a fine-tuned LLM trained on netlist-to-.asc pairs and evaluated on a separate held-out set (Circuits-LTSpice). The input-output mapping is not defined in terms of the reported metrics, and no fitted parameter is renamed as a prediction. The pre-processing, data augmentation, prompt variants, and fine-tuning procedure are transparent and externally grounded: the model is trained with cross-entropy on human-drawn schematic pairs, while CSR, GED, MSSIM, and BLEU are computed on test circuits not used for training. The paper's selection of the best prompt and epoch from test-set curves (Fig. 4 and Fig. 5) does create optimistic bias in the final test numbers because the test set is reused for model selection; however, this is a statistical leakage/overfitting concern rather than circularity, since the test metric is not equal by construction to the training objective and the final architecture is not derived from the evaluation result. Self-citations are incidental and not load-bearing, no uniqueness theorem from the authors is invoked to forbid alternatives, and no known result is renamed as a new derivation. The manuscript's own limitation statements about unfamiliar components and larger circuits further indicate that generalization is treated as an empirical question rather than assumed by construction. Accordingly, no circular step can be exhibited from the paper's equations or dependencies.
Assumptions & free parameters
free parameters (5)
- Prompt variant =
Prompt 3
- Fine-tuning checkpoint epoch =
Epoch 6
- LoRA rank =
r=8
- LoRA scaling factor =
alpha=16
- GED timeout =
60 seconds
assumptions (4)
- domain assumption LTSpice compilation is a valid and sufficient measure of schematic syntactic correctness
- domain assumption GED and MSSIM on compilable outputs are valid proxies for schematic quality and closeness to human design
- domain assumption Human-designed LTSpice circuits are an adequate training and test distribution for ML-generated netlists
- domain assumption The GED normalization and timeout return a consistent comparison across models
Cite this review
Pith. "Pith review of Schemato -- An LLM for Netlist-to-Schematic Conversion." pith.science (2026). https://pith.science/paper/KZASKYAW
@misc{pith2026241113899,
author = {Pith},
title = {Pith review of: Schemato -- An LLM for Netlist-to-Schematic Conversion},
year = {2026},
howpublished = {\url{https://pith.science/paper/KZASKYAW}},
note = {Machine review of arXiv:2411.13899}
}
read the original abstract
Machine learning models are advancing circuit design, particularly in analog circuits. They typically generate netlists that lack human interpretability. This is a problem as human designers heavily rely on the interpretability of circuit diagrams or schematics to intuitively understand, troubleshoot, and develop designs. Hence, to integrate domain knowledge effectively, it is crucial to translate ML-generated netlists into interpretable schematics quickly and accurately. We propose Schemato, a large language model (LLM) for netlist-to-schematic conversion. In particular, we consider our approach in converting netlists to .asc files, text-based schematic description used in LTSpice. Experiments on our circuit dataset show that Schemato achieves up to 76% compilation success rate, surpassing 63% scored by the state-of-the-art LLMs. Furthermore, our experiments show that Schemato generates schematics with an average graph edit distance score and mean structural similarity index measure, scaled by the compilation success rate that are 1.8x and 4.3x higher than the best performing LLMs respectively, demonstrating its ability to generate schematics that are more accurately connected and are closer to the reference human design.
Figures
Figures from the paper (2 more)
Forward citations
Cited by 1 Pith paper
-
CircuitLM: A Multi-Agent LLM-Aided Design Framework for Generating Circuit Schematics from Natural Language Prompts
A five-stage multi-agent pipeline with retrieval from a component database generates CircuitJSON schematics from natural-language prompts, achieving high ERC pass rates but much lower LLM-judge pass rates.
Reference graph
Works this paper leans on
-
[1]
GANA: graph convolutional network based automated netlist annotation for analog circuits,
K. Kunal, T. Dhar, M. Madhusudan, J. Poojary, A. K. Sharma, W. Xu, S. M. Burns, J. Hu, R. Harjani, and S. S. Sapatnekar, “GANA: graph convolutional network based automated netlist annotation for analog circuits,” in2020 Design, Automation & Test in Europe Conference & Exhibition, DATE 2020, Grenoble, France, March 9-13, 2020. IEEE, 2020, pp. 55–60. [Onlin...
arXiv 2020
-
[3]
Invited: Align – open-source analog layout automation from the ground up,
K. Kunal, M. Madhusudan, A. K. Sharma, W. Xu, S. M. Burns, R. Harjani, J. Hu, D. A. Kirkpatrick, and S. S. Sapatnekar, “Invited: Align – open-source analog layout automation from the ground up,” in 2019 56th ACM/IEEE Design Automation Conference (DAC), 2019, pp. 1–4
work page 2019
-
[4]
Ado-llm: Analog design bayesian optimization with in-context learning of large language models,
Y . Yin, Y . Wang, B. Xu, and P. Li, “Ado-llm: Analog design bayesian optimization with in-context learning of large language models,”ArXiv, vol. abs/2406.18770, 2024. [Online]. Available: https://api.semanticscholar.org/CorpusID:270765055
arXiv 2024
-
[5]
W. Cao, M. Benosman, X. Zhang, and R. Ma, “Domain knowledge- infused deep learning for automated analog/radio-frequency circuit parameter optimization,” inProceedings of the 59th ACM/IEEE Design Automation Conference, ser. DAC ’22. New York, NY , USA: Association for Computing Machinery, 2022, p. 1015–1020. [Online]. Available: https://doi.org/10.1145/348...
arXiv 2022
-
[6]
GraCo -- A Graph Composer for Integrated Circuits
S. Uhlich, A. Bonetti, A. Venkitaraman, A. Momeni, R. Matsuo, C.-Y . Hsieh, E. Ohbuchi, and L. Servadei, “GraCo – A graph composer for integrated circuits,”arXiv preprint arXiv:2411.13890, 2024
work page Pith review arXiv 2024
-
[7]
Autockt: Deep reinforcement learning of analog circuit designs,
K. Settaluri, A. Haj-Ali, Q. Huang, K. Hakhamaneshi, and B. Nikolic, “Autockt: Deep reinforcement learning of analog circuit designs,” in 2020 Design, Automation & Test in Europe Conference & Exhibition, DATE 2020, Grenoble, France, March 9-13, 2020. IEEE, 2020, pp. 490–495. [Online]. Available: https://doi.org/10.23919/DATE48585. 2020.9116200
-
[8]
Analog integrated circuit topology synthesis with deep reinforcement learning,
Z. Zhao and L. Zhang, “Analog integrated circuit topology synthesis with deep reinforcement learning,”IEEE Trans. Comput. Aided Des. Integr. Circuits Syst., vol. 41, no. 12, pp. 5138–5151, 2022. [Online]. Available: https://doi.org/10.1109/TCAD.2022.3153437
- [9]
Show all 35 references
-
[10]
Xschem : schematic capture and netlisting eda tool,
S. Schippers and J. J. Jones, “Xschem : schematic capture and netlisting eda tool,” May 2025. [Online]. Available: https: //nanohub.org/resources/xschem
2025
-
[11]
Gpt-4 technical report,
OpenAI and et al., “Gpt-4 technical report,” 2024. [Online]. Available: https://arxiv.org/abs/2303.08774
2024 arXiv
-
[12]
The llama 3 herd of models,
A. Dubey and et al., “The llama 3 herd of models,” 2024. [Online]. Available: https://arxiv.org/abs/2407.21783
2024 arXiv
-
[13]
Autobench: Automatic testbench generation and evaluation using llms for HDL design,
R. Qiu, G. L. Zhang, R. Drechsler, U. Schlichtmann, and B. Li, “Autobench: Automatic testbench generation and evaluation using llms for HDL design,” inProceedings of the 2024 ACM/IEEE International Symposium on Machine Learning for CAD, MLCAD 2024, Salt Lake City, UT, USA, Sep...
2024
-
[14]
Chain-of-descriptions: Improving code llms for vhdl code generation and summarization,
P. Vijayaraghavan, A. Nitsure, C. Mackin, L. Shi, S. Ambrogio, A. Ha- ran, V . Paruthi, A. Elzein, D. Coops, D. Beymer, T. Baldwin, and E. Degan, “Chain-of-descriptions: Improving code llms for vhdl code generation and summarization,” in2024 ACM/IEEE 6th Symposium on Machine L...
2024
-
[15]
Lasp: Llm assisted security property generation for soc verification,
A. Ayalasomayajula, R. Guo, J. Zhou, S. K. Saha, and F. Farahmandi, “Lasp: Llm assisted security property generation for soc verification,” in2024 ACM/IEEE 6th Symposium on Machine Learning for CAD (MLCAD), 2024, pp. 1–7
2024
-
[16]
Lamagic: Language-model-based topology generation for analog integrated circuits,
C. Chang, Y . Shen, S. Fan, J. Li, S. Zhang, N. Cao, Y . Chen, and X. Zhang, “Lamagic: Language-model-based topology generation for analog integrated circuits,” inForty-first International Conference on Machine Learning, ICML 2024, Vienna, Austria, July 21-27,
2024
-
[17]
Analogcoder: Analog circuit design via training-free code generation,
Y . Lai, S. Lee, G. Chen, S. Poddar, M. Hu, D. Z. Pan, and P. Luo, “Analogcoder: Analog circuit design via training-free code generation,” 2024
2024
-
[18]
[Online]
OpenReview.net, 2024. [Online]. Available: https://openreview. net/forum?id=MjGCD8wk1k
2024
-
[19]
Designing an automatic schematic generator for a netlist description,
C. Lageweg, “Designing an automatic schematic generator for a netlist description,”Delft University of Technology, Delft, Netherlands, Tech. Rep, 1998
1998
-
[20]
An automatic netlist-to-schematic generator,
B. Naveen and K. Raghunathan, “An automatic netlist-to-schematic generator,”IEEE Design & Test of Computers, vol. 10, no. 1, pp. 36–41, 1993
1993
-
[21]
Aesthetic routing for transistor schematics,
Lee and McNamee, “Aesthetic routing for transistor schematics,” in1992 IEEE/ACM International Conference on Computer-Aided Design. IEEE, 1992, pp. 35–38
1992
-
[22]
A method for analog circuits visualization,
B. Arsintescu, “A method for analog circuits visualization,” inProceed- ings of the International Conference on Computer Design (ICCD), 1996, pp. 454–459
1996
-
[23]
Chain of thought prompting elicits reasoning in large language models,
J. Wei and X. al., “Chain of thought prompting elicits reasoning in large language models,”CoRR, vol. abs/2201.11903, 2022. [Online]. Available: https://arxiv.org/abs/2201.11903
2022 arXiv
-
[24]
Automatic analog schematic diagram generation based on building block classification and reinforcement learning,
H.-Y . Hsu and M. P.-H. Lin, “Automatic analog schematic diagram generation based on building block classification and reinforcement learning,” inProceedings of the 2022 ACM/IEEE Workshop on Machine Learning for CAD, 2022, pp. 43–48
2022
-
[25]
Pytorch fsdp: Experiences on scaling fully sharded data parallel,
Y . Zhao, A. Gu, R. Varma, L. Luo, C.-C. Huang, M. Xu, L. Wright, H. Shojanazeri, M. Ott, S. Shleifer, A. Desmaison, C. Balioglu, P. Damania, B. Nguyen, G. Chauhan, Y . Hao, A. Mathews, and S. Li, “Pytorch fsdp: Experiences on scaling fully sharded data parallel,”
-
[26]
torchtune: Pytorch’s finetuning library,
torchtune maintainers and contributors, “torchtune: Pytorch’s finetuning library,” Apr. 2024. [Online]. Available: https//github.com/pytorch/ torchtune
2024
-
[27]
Exploring network structure, dynamics, and function using networkx,
A. A. Hagberg, D. A. Schult, and P. J. Swart, “Exploring network structure, dynamics, and function using networkx,” inProceedings of the 7th Python in Science Conference, G. Varoquaux, T. Vaught, and J. Millman, Eds., Pasadena, CA USA, 2008, pp. 11 – 15
2008
-
[28]
An Exact Graph Edit Distance Algorithm for Solving Pattern Recognition Problems,
Z. Abu-Aisheh, R. Raveaux, J.-Y . Ramel, and P. Martineau, “An Exact Graph Edit Distance Algorithm for Solving Pattern Recognition Problems,” in4th International Conference on Pattern Recognition Applications and Methods 2015, Lisbon, Portugal, Jan. 2015. [Online]. Available: ...
2015
-
[29]
String edit distance, random walks and graph matching,
A. Robles-Kelly and E. Hancock, “String edit distance, random walks and graph matching,” 02 2002, pp. 107–129
2002
-
[30]
Bleu: a method for automatic evaluation of machine translation,
K. Papineni, S. Roukos, T. Ward, and W.-J. Zhu, “Bleu: a method for automatic evaluation of machine translation,” inProceedings of the 40th Annual Meeting on Association for Computational Linguistics, ser. ACL ’02. USA: Association for Computational Linguistics, 2002, p. 311–3...
2002
-
[31]
Codebleu: a method for automatic evaluation of code synthesis,
S. Ren, D. Guo, S. Lu, L. Zhou, S. Liu, D. Tang, N. Sundaresan, M. Zhou, A. Blanco, and S. Ma, “Codebleu: a method for automatic evaluation of code synthesis,” 2020. [Online]. Available: https://arxiv.org/abs/2009.10297
2020 arXiv
-
[32]
Image quality assess- ment: from error visibility to structural similarity,
Z. Wang, A. Bovik, H. Sheikh, and E. Simoncelli, “Image quality assess- ment: from error visibility to structural similarity,”IEEE Transactions on Image Processing, vol. 13, no. 4, pp. 600–612, 2004
2004
-
[33]
Amsnet 2.0: A large ams database with ai segmentation for net detection,
Y . Shi, Z. Tao, Y . Gao, L. Huang, H. Wang, Z. Yu, T.-J. Lin, and L. He, “Amsnet 2.0: A large ams database with ai segmentation for net detection,” 2025. [Online]. Available: https://arxiv.org/abs/2505.09155
2025 arXiv
-
[35]
mixup: Beyond empirical risk minimization,
H. Zhang, M. Cisse, Y . N. Dauphin, and D. Lopez-Paz, “mixup: Beyond empirical risk minimization,” 2018. [Online]. Available: https://arxiv.org/abs/1710.09412
2018 arXiv
-
[2023]
Available: https://arxiv.org/abs/2304.11277
[Online]. Available: https://arxiv.org/abs/2304.11277
-
[2024]
Available: https://www.analog.com/en/resources/ design-tools-and-calculators/ltspice-simulator.html
[Online]. Available: https://www.analog.com/en/resources/ design-tools-and-calculators/ltspice-simulator.html
Reviewed August 12, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.