Characterization and parameterized random generation of digital circuits
DAC '96 Proceedings of the 33rd annual Design Automation Conference
Generation of synthetic sequential benchmark circuits
FPGA '97 Proceedings of the 1997 ACM fifth international symposium on Field-programmable gate arrays
Proceedings of the 1997 international symposium on Physical design
Computers and Intractability: A Guide to the Theory of NP-Completeness
Computers and Intractability: A Guide to the Theory of NP-Completeness
Guest Editors' Introduction: Benchmarking for Design and Test
IEEE Design & Test
Overview of Popular Benchmark Sets
IEEE Design & Test
The Scientific Method and Design and Test
IEEE Design & Test
Statistical Analysis of Computational Tests of Algorithms and Heuristics
INFORMS Journal on Computing
VLSID '98 Proceedings of the Eleventh International Conference on VLSI Design: VLSI for Signal Processing
Efficent suboptimal state assignment for large sequential machines
EURO-DAC '90 Proceedings of the conference on European design automation
Fast and compact sequential circuits for the FPGA-based reconfigurable systems
Journal of Systems Architecture: the EUROMICRO Journal - Special issue: Reconfigurable systems
Effective and efficient FPGA synthesis through general functional decomposition
Journal of Systems Architecture: the EUROMICRO Journal - Special issue: Reconfigurable systems
DSD '04 Proceedings of the Digital System Design, EUROMICRO Systems
On SAT Instance Classes and a Method for Reliable Performance Experiments with SAT Solvers
Annals of Mathematics and Artificial Intelligence
Optimality study of logic synthesis for LUT-based FPGAs
Proceedings of the 2006 ACM/SIGDA 14th international symposium on Field programmable gate arrays
Constraint satisfaction problem using modified branch and bound algorithm
WSEAS Transactions on Computers
Dedicated hardware for inheritance-oriented crossover operation
WSEAS Transactions on Circuits and Systems
A low-power scheduling tool for system on a chip designs
WSEAS Transactions on Circuits and Systems
Link-load balance aware mapping and routing for NoC
WSEAS Transactions on Circuits and Systems
Evaluating las vegas algorithms: pitfalls and remedies
UAI'98 Proceedings of the Fourteenth conference on Uncertainty in artificial intelligence
Life-Inspired systems and their quality-driven design
ARCS'06 Proceedings of the 19th international conference on Architecture of Computing Systems
Automatic generation of synthetic sequential benchmark circuits
IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
Automatic design of optimal logic circuits based on ternary quantum-dot cellular automata
WSEAS Transactions on Circuits and Systems
| Hi-index | 0.00 |
This paper focuses on benchmarking, which is the main experimental approach to the design method and EDA-tool analysis, characterization and evaluation. We discuss the importance and difficulties of benchmarking, as well as the recent research effort related to it. To resolve several serious problems related to quality of benchmarking and use of practical industrial benchmarks, we proposed an adequate benchmarking methodology based on the statistical experimental design approach, and developed corresponding digital circuit benchmark generators. These benchmark generators enable research, evaluation and fine-tuning of circuit synthesis methods and EDA-tools largely independent of the actual industrial benchmarks, and much better than having only some industrial benchmarks. Using the results of extensive experiments that involved large sets of diverse benchmarks generated with our FSM benchmark generator, we discuss several crucial problems of benchmarking and demonstrate how to resolve them.