The Value of Architecturally Significant Information Extracted from Patterns for Architecture Evaluation: A Controlled Experiment

Authors:
Muhammad Ali Babar;Barbara Kitchenham;Piyush Maheshwari
Affiliations:
National ICT Australia Ltd. and University of New South Wales, Australia;National ICT Australia Ltd. and University of New South Wales, Australia;National ICT Australia Ltd. and University of New South Wales, Australia
Venue:
ASWEC '06 Proceedings of the Australian Software Engineering Conference
Year:
2006

Citing 0
Cited 4

Eliciting better quality architecture evaluation scenarios: a controlled experiment on top-down vs. bottom-up

Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering
Software engineering article types: An analysis of the literature

Journal of Systems and Software
Assessing the value of architectural information extracted from patterns for architecting

EASE'06 Proceedings of the 10th international conference on Evaluation and Assessment in Software Engineering
Assessment of a framework for designing and evaluating security sensitive architecture

EASE'08 Proceedings of the 12th international conference on Evaluation and Assessment in Software Engineering

Quantified Score

Hi-index	0.00

Visualization

Abstract

We have developed an approach to identify and capture architecturally significant information from patterns (ASIP), which can be used to improve architecture design and evaluation. Our experimental goal was to evaluate whether the use of the ASIP improves the quality of scenarios developed to evaluate software architecture. Out of 24 subjects 21 were experienced software engineers who had returned to University for a postgraduate studies and remaining 3 were fourth year undergraduate students. All participants were taking a course in software architecture. The participants were randomly assigned to two groups of equal size. Both groups developed scenarios for architecture evaluation. One group (treatment group) was given ASIP information the other (control group) was not. The outcome variable was the quality of the scenarios produced by each participant working individually. The treatment group participants also completed a post-experiment questionnaire. Our results support the hypothesis that ASIP information assists scenario development in the context of architecture evaluation.