Measure for Measure: A two study multi-trait multi-method investigation of construct validity in IS research

Authors:
Ana Ortiz De Guinea;Ryad Titah;Pierre-Majorique Léger
Affiliations:
-;-;-
Venue:
Computers in Human Behavior
Year:
2013

Citing 22
Cited 0

Measuring system usage: implications for IS theory testing

Management Science
Audience engagement in multimedia presentations

ACM SIGMIS Database
Combining IS Research Methods: Towards a Pluralist Methodology

Information Systems Research
A Multidimensional Commitment Model of Volitional Systems Adoption and Usage Behavior

Journal of Management Information Systems
Organizational Buyers' Adoption and Use of B2B Electronic Marketplaces: Efficiency-and Legitimacy-Oriented Perspectives

Journal of Management Information Systems
On the Measurement of Ideation Quality

Journal of Management Information Systems
Review: Integrating cognitive load theory and concepts of human-computer interaction

Computers in Human Behavior
Validating instruments in MIS research

MIS Quarterly
Validation in information systems research: a state-of-the-art assessment

MIS Quarterly
The role of individual memory and attention processes during electronic brainstorming

MIS Quarterly
Enhancing the design of web navigation systems: the influence of user disorientation on engagement and performance

MIS Quarterly
What does the brain tell us about trust and distrust? evidence from a functional neuroimaging study

MIS Quarterly
Affect in web interfaces: a study of the impacts of web page visual complexity and order

MIS Quarterly
Measurement and meaning in information systems and organizational research: methodological and philosophical foundations

MIS Quarterly
Construct measurement and validation procedures in MIS and behavioral research: integrating new and existing techniques

MIS Quarterly
Research Commentary---NeuroIS: The Potential of Cognitive Neuroscience for Information Systems Research

Information Systems Research
Are there optimal levels of arousal to memory? Effects of arousal, centrality, and familiarity on brand memory in video games

Computers in Human Behavior
Review: Engagement in digital entertainment games: A systematic review

Computers in Human Behavior
The impact of engagement with social networking sites (SNSs) on cognitive skills

Computers in Human Behavior
Why break the habit of a lifetime? rethinking the roles of intention, habit, and emotion in continuing information technology use

MIS Quarterly
Estimating the effect of common method variance: the method-method pair technique with an illustration from TAM research

MIS Quarterly
On the use of neurophysiological tools in is research: developing a research agenda for neurois

MIS Quarterly

Quantified Score

Hi-index	0.00

Visualization

Abstract

Given the importance and criticality of instrument validation in IS research, the main objective of this study is to provide a systematic assessment of IS construct validity via multi-trait multi-method (MTMM) matrix. To do so, the paper uses structurally different methods - neurophysiological and self-reported instruments - to measure three important and commonly used IS constructs: engagement, arousal and cognitive load in two different experimental settings. The experiments involved seventeen (17) and twenty-four (24) participants respectively and consisted in using different IS to execute a set of both instrumental and hedonic tasks. The results generally support MTMM matrix expectations and shed light on the complexity of detecting the nature of mono-method bias. Specifically, the results show that primitive perceptual IS constructs such as arousal seem to be less affected by mono-method bias, whereas more complex perceptual constructs such as engagement or cognitive load have higher within method correlations. There are two complementary explanations for the within method correlations: (a) a combination between complexity of trait and method and (b) method effects that are congeneric.