Behind the curtain: lessons learned from a Wizard of Oz field experiment

Authors:
Kevin F. White;Wayne G. Lutters
Affiliations:
UMBC, Baltimore, MD;UMBC, Baltimore, MD
Venue:
ACM SIGGROUP Bulletin - Special issue on community-based learning: explorations into theoretical groundings, empirical findings and computer support
Year:
2003

Citing 15
Cited 2

Prototyping an intelligent agent through Wizard of Oz

CHI '93 Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems
Wizard of Oz studies: why and how

IUI '93 Proceedings of the 1st international conference on Intelligent user interfaces
Groupware and social dynamics: eight challenges for developers

Communications of the ACM
GroupLens: an open architecture for collaborative filtering of netnews

CSCW '94 Proceedings of the 1994 ACM conference on Computer supported cooperative work
Augmenting the organizational memory: a field study of answer garden

CSCW '94 Proceedings of the 1994 ACM conference on Computer supported cooperative work
Answer Garden 2: merging organizational memory with collaborative help

CSCW '96 Proceedings of the 1996 ACM conference on Computer supported cooperative work
PHOAKS: a system for sharing recommendations

Communications of the ACM
Yenta: a multi-agent, referral-based matchmaking system

AGENTS '97 Proceedings of the first international conference on Autonomous agents
Suede: a Wizard of Oz prototyping tool for speech user interfaces

UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
Composing letters with a simulated listening typewriter

Communications of the ACM
Expertise recommender: a flexible recommendation system and architecture

CSCW '00 Proceedings of the 2000 ACM conference on Computer supported cooperative work
Interaction Design

Interaction Design
Achieving safety: a field study of boundary objects in aircraft technical support

CSCW '02 Proceedings of the 2002 ACM conference on Computer supported cooperative work
Predicting human interruptibility with sensors: a Wizard of Oz feasibility study

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Wizard-of-Oz prototyping for co-operative interaction design of graphical user interfaces

Proceedings of the third Nordic conference on Human-computer interaction

Structuring cross-organizational knowledge sharing

Proceedings of the 2007 international ACM conference on Supporting group work
Towards virtualizing the helpdesk: assessing the relevance of knowledge across distance

Proceedings of the 2nd ACM Symposium on Computer Human Interaction for Management of Information Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

Large scale, organization-wide groupware systems are high risk development efforts. Requirements gathering and early evaluation are constrained by the need for the system to attain a critical mass of users and content. One approach to mitigate this risk is to employ Wizard of Oz style system simulations during the requirements gathering phase. While this method has historically been used to test quasi-functional system prototypes, we have found it to be a useful method for assessing organizational feasibility. After introducing this adaptation of the Wizard of Oz method, our approach is grounded with a case study in which it is was successfully used as a proof-of-concept requirements gathering exercise for an expertise recommender and organizational memory system project. Transferable lessons learned are distilled and discussed.