Automatic goal-oriented classification of failure behaviors for testing XML-based multimedia software applications: An experimental case study

Authors:
W. K. Chan;M. Y. Cheng;S. C. Cheung;T. H. Tse
Affiliations:
Department of Computer Science, The University of Hong Kong, Pokfulam, Hong Kong;Department of Computer Science, The University of Hong Kong, Pokfulam, Hong Kong;Department of Computer Science, Hong Kong University of Science and Technology, Clear Water Bay, Hong Kong;Department of Computer Science, The University of Hong Kong, Pokfulam, Hong Kong
Venue:
Journal of Systems and Software - Special issue: Quality software
Year:
2006

Citing 10
Cited 4

Designing programs that check their work

Journal of the ACM (JACM)
Communication and computing for distributed multimedia systems

Communication and computing for distributed multimedia systems
Maintaining knowledge about temporal intervals

Communications of the ACM
Interval-Based Conceptual Models for Time-Dependent Multimedia Data

IEEE Transactions on Knowledge and Data Engineering
Automated test case generation for the stress testing of multimedia systems

Software—Practice & Experience
Automated support for classifying software failure reports

Proceedings of the 25th International Conference on Software Engineering
A linking and interaction evaluation test set for SMIL

Proceedings of the fifteenth ACM conference on Hypertext and hypermedia
Towards the Application of Classification Techniques to Test and Identify Faults in Multimedia Systems

QSIC '04 Proceedings of the Quality Software, Fourth International Conference
Integrated system interoperability testing with applications to VoIP

IEEE/ACM Transactions on Networking (TON)
A media synchronization survey: reference model, specification, and case studies

IEEE Journal on Selected Areas in Communications

An empirical comparison between direct and indirect test result checking approaches

Proceedings of the 3rd international workshop on Software quality assurance
PAT: A pattern classification approach to automatic reference oracles for the testing of mesh simplification programs

Journal of Systems and Software
Identifying poorly documented object oriented software components

International Journal of Hybrid Intelligent Systems
Exhaustive and heuristic search approaches for learning a software defect prediction model

Engineering Applications of Artificial Intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

When testing multimedia software applications, we need to overcome important issues such as the forbidding size of the input domains, great difficulties in repeating non-deterministic test outcomes, and the test oracle problem. A statistical testing methodology is proposed. It applies pattern classification techniques enhanced with the notion of test dimensions. Test dimensions are orthogonal properties of associated test cases. Temporal properties are being studied in the experimentation in this paper. For each test dimension, a pattern classifier is trained on the normal and abnormal behaviors. A type of failure is said to be classified if it is recognized by the classifier. Test cases can then be analyzed by the failure pattern recognizers. Experiments show that some test dimensions are more effective than others in failure identification and classification.