A Comparative Study of Software Model Checkers as Unit Testing Tools: An Industrial Case Study

Authors:
Moonzoo Kim;Yunho Kim;Hotae Kim
Affiliations:
KAIST, Daejon;KAIST, Daejon;Samsung Electronics, Suwon
Venue:
IEEE Transactions on Software Engineering
Year:
2011

Citing 0
Cited 8

Automated analysis of industrial embedded software

ATVA'11 Proceedings of the 9th international conference on Automated technology for verification and analysis
Controlled composition and abstraction for bottom-up integration and verification of abstract components

Information and Software Technology
Experience of improving the blast static verification tool

Programming and Computing Software
CONCURRIT: testing concurrent programs with programmable state-space exploration

HotPar'12 Proceedings of the 4th USENIX conference on Hot Topics in Parallelism
CONCURRIT: a domain specific language for reproducing concurrency bugs

Proceedings of the 34th ACM SIGPLAN conference on Programming language design and implementation
Enabling dynamic assertion-based verification of embedded software through model-driven design

DATE '12 Proceedings of the Conference on Design, Automation and Test in Europe
On the integration of model-driven design and dynamic assertion-based verification for embedded software

Journal of Systems and Software
Formal process algebraic modeling, verification, and analysis of an abstract Fuzzy Inference Cloud Service

The Journal of Supercomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Conventional testing methods often fail to detect hidden flaws in complex embedded software such as device drivers or file systems. This deficiency incurs significant development and support/maintenance cost for the manufacturers. Model checking techniques have been proposed to compensate for the weaknesses of conventional testing methods through exhaustive analyses. Whereas conventional model checkers require manual effort to create an abstract target model, modern software model checkers remove this overhead by directly analyzing a target C program, and can be utilized as unit testing tools. However, since software model checkers are not fully mature yet, they have limitations according to the underlying technologies and tool implementations, potentially critical issues when applied in industrial projects. This paper reports our experience in applying Blast and CBMC to testing the components of a storage platform software for flash memory. Through this project, we analyzed the strong and weak points of two different software model checking technologies in the viewpoint of real-world industrial application—counterexample-guided abstraction refinement with predicate abstraction and SAT-based bounded analysis.