Methodological issues in experimental IS research: experiences and recommendations

Authors:
Sirkka L. Jarvenpaa;Gary W. Dickson;Gerardine DeSanctis
Affiliations:
Department of Management Sciences, University of Minnesota Minneapolis, Minnesota;Department of Management Sciences, University of Minnesota Minneapolis, Minnesota;Department of Management Sciences, University of Minnesota Minneapolis, Minnesota
Venue:
MIS Quarterly
Year:
1985

Citing 2
Cited 7

An investigation of the effects of computer graphics on executive decision-making in an inventory control environment

An investigation of the effects of computer graphics on executive decision-making in an inventory control environment
Human Problem Solving

Human Problem Solving

Critical success factors of decision support systems: An experimental study

ACM SIGMIS Database
The Effectiveness Of Graphic And Tabular Presentation Under Time Pressure And Task Complexity

Information Resources Management Journal
The Challenge of Relating IS Research to Practice

Information Resources Management Journal
A Model of the Motivation for IT Retraining

Information Resources Management Journal
On the use of neurophysiological tools in is research: developing a research agenda for neurois

MIS Quarterly
How to conduct a functional magnetic resonance (fMRI) study in social science research

MIS Quarterly
An investigation of information systems use patterns: technological events as triggers, the effect of time, and consequences for performance

MIS Quarterly

Quantified Score

Hi-index	0.00

Visualization

Abstract

Within the last ten years the use of experimental methodology in information systems (IS) research has substantially increased. However, despite our experience with experimentation, studies continue to suffer from methodological problems. These problems have led to an accumulation of conflicting results in several areas of IS research. Moreover, future research studies will keep producing contradictory results unless researchers begin to answer questions of task and measurement validity before reporting their experimental findings. This article discusses common methodological problems in experimental IS studies and, through a description of a series of graphics experiments at the University of Minnesota, illustrates the particularly acute problem of low internal validity. Suggestions are offered to experimental IS researchers on how some of these common problems can be alleviated or even avoided, particularly in studies on the use of managerial graphics.