Quality in use of domain-specific languages: a case study

Authors:
Ankica Barišić;Vasco Amaral;Miguel Goulão;Bruno Barroca
Affiliations:
Universidade Nova de Lisboa, Lisbon, Portugal;Universidade Nova de Lisboa, Lisbon, Portugal;Universidade Nova de Lisboa, Lisbon, Portugal;Universidade Nova de Lisboa, Lisbon, Portugal
Venue:
Proceedings of the 3rd ACM SIGPLAN workshop on Evaluation and usability of programming languages and tools
Year:
2011

Citing 10
Cited 0

A software engineering experiment in software component generation

Proceedings of the 18th international conference on Software engineering
What happened when database researchers met usability

Information Systems
An Empirical Comparison of Seven Programming Languages

Computer
Model-Driven Development: A Metamodeling Foundation

IEEE Software
When and how to develop domain-specific languages

ACM Computing Surveys (CSUR)
Modeling the Experimental Software Engineering Process

QUATIC '07 Proceedings of the 6th International Conference on Quality of Information and Communications Technology
Handbook of Usability TestingXXX: Howto Plan, Design, and Conduct Effective Tests

Handbook of Usability TestingXXX: Howto Plan, Design, and Conduct Effective Tests
Software Language Engineering: Creating Domain-Specific Languages Using Metamodels

Software Language Engineering: Creating Domain-Specific Languages Using Metamodels
Staking claims: a history of programming language design claims and evidence: a positional work in progress

Evaluation and Usability of Programming Languages and Tools
Program comprehension of domain-specific and general-purpose languages: comparison using a family of experiments

Empirical Software Engineering

Quantified Score

Hi-index	0.00

Visualization

Abstract

Domain-Specific Languages (DSLs) are claimed to increment productivity, while reducing the required maintenance and programming expertise. In this context, DSLs usability is a key factor for its successful adoption. In this paper, we propose a systematic approach based on User Interfaces Experimental validation techniques to assess the impact of the introduction of DSLs on the productivity of domain experts. To illustrate this evaluation approach we present a case study of a DSL for High Energy Physics (HEP). The DSL on this case study, called Pheasant (PHysicist's EAsy Analysis Tool), is assessed in contrast with a pre-existing baseline, using General Purpose Languages (GPLs) such as C++. The comparison combines quantitative and qualitative data, collected with users from a real-world setting. Our assessment includes Physicists with programming experience with two profiles; ones with no experience with the previous framework used in the project and other experienced. This work's contribution highlights the problem of the absence of systematic approaches for experimental validation of DSLs. It also illustrates how an experimental approach can be used in the context of a DSL evaluation during the Software Languages Engineering activity, with respect to its impact on effectiveness and efficiency.