Data Quality Tags and Decision-making: Improving the Design and Validity of Experimental Studies

Authors:
Rosanne Price;Graeme Shanks
Affiliations:
Dept. of Information Systems, The University of Melbourne, Victoria, Australia 3010;Dept. of Information Systems, The University of Melbourne, Victoria, Australia 3010
Venue:
Proceedings of the 2008 conference on Collaborative Decision Making: Perspectives and Challenges
Year:
2008

Citing 9
Cited 0

Conducting and analyzing a contextual interview (excerpt)

Human-computer interaction
Anchoring data quality dimensions in ontological foundations

Communications of the ACM
Data quality in context

Communications of the ACM
Contextual design: defining customer-centered systems

Contextual design: defining customer-centered systems
Interaction Design

Interaction Design
The Impact of Data Quality Information on Decision Making: An Exploratory Analysis

IEEE Transactions on Knowledge and Data Engineering
The Impact of Experience and Time on the Use of Data Quality Information in Decision Making

Information Systems Research
Enhancing Decision Making with Process Metadata: Theoretical Framework, Research Tool, and Exploratory Examination

HICSS '06 Proceedings of the 39th Annual Hawaii International Conference on System Sciences - Volume 08
Beyond accuracy: what data quality means to data consumers

Journal of Management Information Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

Providing decision-makers with information about the quality of the data they are using has been empirically shown to impact both decision outcomes and the decision-making process. However, little attention has been paid to the usability and relevance of the data quality tags and the experimental materials used in studies to date. In this paper, we highlight the potential impact of these issues on experimental validity and propose the use of interaction design techniques to address this problem. We describe current work that applies these techniques, including contextual inquiry and participatory design, to improve the design and validity of planned data quality tagging experiments. The benefits of this approach are illustrated by showing how the outcomes of a series of contextual inquiry interviews have influenced the design of the experimental materials. We argue that interaction design techniques should be used more widely for experimental design.