RECORD
An Automated Testing and Debugging Toolkit for Gate-Level Logic Synthesis Applications
Software Engineering · Submitted 17 Jul 2022
abstract compiled · 2026-09-23 · no language-model review
The authors' main claim Experimental results show that our fuzzer captures defects in mockturtle, ABC, and LSOracle with 10x smaller testcases and our testcase minimizer extracts minimal failure-inducing cores using 2x fewer oracle calls.
The compiled record
The paper's own sentences, arranged. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. Numbers in the tables are the authors', checked by code. No sentence in this record was written by a model.
Open the compiled record
The abstract, sentence by sentence
Correctness and robustness are essential for logic synthesis applications, but they are often only tested with a limited set of benchmarks. Moreover, when the application fails on a large benchmark, the debugging process may be tedious and time-consuming. In some fields such as compiler construction, automatic testing and debugging tools are well-developed to support developers and provide minimal guarantees on program quality. In this paper, we adapt fuzz testing and delta debugging techniques and specialize them for gate-level netlists commonly used in logic synthesis. Our toolkit improves over similar tools specialized for the AIGER format by supporting other gate-level netlist formats and by allowing a tight integration to provide 10x speed-up. Experimental results show that our fuzzer captures defects in mockturtle, ABC, and LSOracle with 10x smaller testcases and our testcase minimizer extracts minimal failure-inducing cores using 2x fewer oracle calls.
background contribution method result interpretation main claim
| # | sentence | role | the authors' own work | states the main conclusion | strength |
|---|---|---|---|---|---|
| s0 | Correctness and robustness are essential for logic synthesis applications, but they are often only tested with a limited set of benchmarks. | background 0.86 | 0.07 | 0.02 | asserted 0.97 |
| s1 | Moreover, when the application fails on a large benchmark, the debugging process may be tedious and time-consuming. | background 0.91 | 0.06 | 0.02 | hedged possibility 1.00 |
| s2 | In some fields such as compiler construction, automatic testing and debugging tools are well-developed to support developers and provide minimal guarantees on program quality. | background 0.97 | 0.03 | 0.02 | asserted 0.99 |
| s3 | In this paper, we adapt fuzz testing and delta debugging techniques and specialize them for gate-level netlists commonly used in logic synthesis. | contribution 0.76 | 0.92 | 0.10 | asserted 0.99 |
| s4 | Our toolkit improves over similar tools specialized for the AIGER format by supporting other gate-level netlist formats and by allowing a tight integration to provide 10x speed-up. | contribution 0.98 | 0.91 | 0.17 | asserted 1.00 |
| s5 | Experimental results show that our fuzzer captures defects in mockturtle, ABC, and LSOracle with 10x smaller testcases and our testcase minimizer extracts minimal failure-inducing cores using 2x fewer oracle calls. | result 1.00 | 0.96 | 0.59 | asserted 1.00 |
What was examined, and what was not
- arXiv listing abstract v1
- full text
- figures and tables
- references and citing sentences
- relations to other papers
- P abstract
- S sections
- T body sentences
- C citations
- R cross-paper relations
The paper
Original abstract
Correctness and robustness are essential for logic synthesis applications, but they are often only tested with a limited set of benchmarks. Moreover, when the application fails on a large benchmark, the debugging process may be tedious and time-consuming. In some fields such as compiler construction, automatic testing and debugging tools are well-developed to support developers and provide minimal guarantees on program quality. In this paper, we adapt fuzz testing and delta debugging techniques and specialize them for gate-level netlists commonly used in logic synthesis. Our toolkit improves over similar tools specialized for the AIGER format by supporting other gate-level netlist formats and by allowing a tight integration to provide 10x speed-up. Experimental results show that our fuzzer captures defects in mockturtle, ABC, and LSOracle with 10x smaller testcases and our testcase minimizer extracts minimal failure-inducing cores using 2x fewer oracle calls.
Human review
How the literature uses it
What this paper does with the arXiv papers it cites
What it cites · 1 sentence without a confident label
Uses the method or tool of 1 paper
-
The testing and debugging toolkit described in this section is implemented in mockturtle[Available: <https://github.com/lsils/mockturtle>] as part of the EPFL open-source logic synthesis libraries [ref] .
The EPFL Logic Synthesis Libraries · Usage Example · 0.89
Cites as background 1 paper
-
Sophisticated algorithmic solutions are readily available as open-sourced libraries and tools [ref] .
The EPFL Logic Synthesis Libraries · Introduction · 0.88
Discussion
Know something about this paper? Leave a comment, or highlight any passage above to comment on it.