Design science research evaluation

Authors:
Ken Peffers;Marcus Rothenberger;Tuure Tuunanen;Reza Vaezi
Affiliations:
Lee Business School, University of Nevada Las Vegas, Las Vegas, NV;Lee Business School, University of Nevada Las Vegas, Las Vegas, NV;University of Oulu, Oulu, Finland;University of Houston, Houston, TX
Venue:
DESRIST'12 Proceedings of the 7th international conference on Design Science Research in Information Systems: advances in theory and practice
Year:
2012

Citing 10
Cited 4

Modeling design processes

AI Magazine
Systems development in information systems research

Journal of Management Information Systems - Special issue on management support systems
Diversity in information systems action research methods

European Journal of Information Systems
A Query-Driven Approach to the Design and Management of Flexible Database Systems

Journal of Management Information Systems
Extending Critical Success Factors Methodology to Facilitate Broadly Participative Information Systems Planning

Journal of Management Information Systems
A Design Science Research Methodology for Information Systems Research

Journal of Management Information Systems
Design alternatives for the evaluation of design science research artifacts

Proceedings of the 4th International Conference on Design Science Research in Information Systems and Technology
Designing an evaluation framework for IT service management

Information and Management
Design science in information systems research

MIS Quarterly
Action design research

MIS Quarterly

ERP event log preprocessing: timestamps vs. accounting logic

DESRIST'13 Proceedings of the 8th international conference on Design Science at the Intersection of Physical and Virtual Design
Enriching process models for business process compliance checking in ERP environments

DESRIST'13 Proceedings of the 8th international conference on Design Science at the Intersection of Physical and Virtual Design
A decision support tool to define scope in IT service management process assessment and improvement

DESRIST'13 Proceedings of the 8th international conference on Design Science at the Intersection of Physical and Virtual Design
Case Studies in research: Choosing the right business process maturity model

Information and Management

Quantified Score

Hi-index	0.00

Visualization

Abstract

The consensus view is that the rigorous evaluation of design science (DS) artifacts is essential. There are many types of DS artifacts and many forms of evaluation; what is missing is guidance for how to perform the evaluation, more specifically, what evaluation methods to use with specific DS research outputs. Here we find and review 148 DS research articles published in a selected set of information systems (IS), computer science (CS) and engineering journals. We analyze the articles to develop taxonomies of DS artifact types and artifact evaluation methods; we apply these taxonomies to determine which evaluation methods are associated in the literature with particular artifacts. We show that there are several popular "artifact - evaluation method" combinations in the literature. The results inform DS researchers of usual and customary combinations of research artifacts and evaluation methods, potentially providing them with rationale and justification for an evaluation method selection.