Software complexity: measures and methods
Software complexity: measures and methods
Research Issues in No-Futz Computing
HOTOS '01 Proceedings of the Eighth Workshop on Hot Topics in Operating Systems
Towards availability benchmarks: a case study of software raid systems
ATEC '00 Proceedings of the annual conference on USENIX Annual Technical Conference
Towards an understanding of decision complexity in IT configuration
Proceedings of the 2007 symposium on Computer human interaction for the management of information technology
Using CogTool to model programming tasks
Evaluation and Usability of Programming Languages and Tools
Performance management and quantitative modeling of IT service processes using mashup patterns
Proceedings of the 7th International Conference on Network and Services Management
| Hi-index | 0.00 |
Configuration is the process whereby components are assembled or adjusted to produce a functional system that operates at a specified level of performance. Today, the complexity of configuration is a major impediment to deploying and managing computer systems. We describe an approach to quantifying configuration complexity, with the ultimate goal of producing a configuration complexity benchmark. Our belief is that such a benchmark can drive progress towards self-configuring systems. Unlike traditional workload-based performance benchmarks, our approach is process-based. It generates metrics that reflect the level of human involvement in the configuration process, quantified by interaction time and probability of successful configuration. It computes the metrics using a model of a standardized human operator, calibrated in advance by a user study that measures operator behavior on a set of parameterized canonical configuration actions. The model captures the human component of configuration complexity at low cost and provides representativeness and reproducibility.