Automated Testing of Timeliness: A Case Study

Authors:
Robert Nilsson;Jeff Offutt
Affiliations:
University of Skovde;George Mason University
Venue:
AST '07 Proceedings of the Second International Workshop on Automation of Software Test
Year:
2007

Citing 11
Cited 1

A probe effect in concurrent programs

Software—Practice & Experience
A theory of timed automata

Theoretical Computer Science
Fundamental issues in testing distributed real-time systems

Real-Time Systems - Special issue: dependability of real-time software
Deadline Scheduling for Real-Time Systems: Edf and Related Algorithms

Deadline Scheduling for Real-Time Systems: Edf and Related Algorithms
Real-Time Systems and Programming Languages: ADA 95, Real-Time Java, and Real-Time POSIX

Real-Time Systems and Programming Languages: ADA 95, Real-Time Java, and Real-Time POSIX
Testing real-time systems using genetic algorithms

Software Quality Control
Making Worst Case Execution Time Analysis for Hard Real-Time Tasks on State of the Art Processors Feasible

RTCSA '99 Proceedings of the Sixth International Conference on Real-Time Computing Systems and Applications
Timed Automata as Task Models for Event-Driven Systems

RTCSA '99 Proceedings of the Sixth International Conference on Real-Time Computing Systems and Applications
Using Model Checking to Generate Tests from Specifications

ICFEM '98 Proceedings of the Second IEEE International Conference on Formal Engineering Methods
Generic Approach to Schedulability Analysis of Real-Time Systems (Uppsala Dissertations from the Faculty of Science & Technology, 49)

Generic Approach to Schedulability Analysis of Real-Time Systems (Uppsala Dissertations from the Faculty of Science & Technology, 49)
Mutation-Based Testing Criteria for Timeliness

COMPSAC '04 Proceedings of the 28th Annual International Computer Software and Applications Conference - Volume 01

Model-based fault detection in context-aware adaptive applications

Proceedings of the 16th ACM SIGSOFT International Symposium on Foundations of software engineering

Quantified Score

Hi-index	0.00

Visualization

Abstract

A problem with testing timeliness of real-time applications is the response-time dependency on the execution order of concurrent tasks. Conventional test methods ignore task interleaving and timing and thus do not help determine which execution orders need to be exercised to test temporal correctness. Model based mutation testing has been proposed to generate inputs and determine the execution orders that need to be verified to increase confidence in timeliness. This paper evaluate a mutation-based framework for automated testing of timeliness by applying it on a small control system running on Linux/RTAI. The experiments presented in this paper indicate that mutation-based test cases are more effective than random and stress tests in finding both naturally occurring and randomly seeded timeliness faults.