An iterative design methodology for user-friendly natural language office information applications
ACM Transactions on Information Systems (TOIS)
Ozlab: a simple demonstration tool for prototyping interactivity
Proceedings of the second Nordic conference on Human-computer interaction
Wizard-of-Oz prototyping for co-operative interaction design of graphical user interfaces
Proceedings of the third Nordic conference on Human-computer interaction
Wizard of Oz experiments for companions
Proceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology
Proceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology
Designing relational agents as long term social companions for older adults
IVA'12 Proceedings of the 12th international conference on Intelligent Virtual Agents
| Hi-index | 0.00 |
Novel speech systems such as the conversational agents being developed by the Companions Project (www.companions-project.org) can be simulated using the Wizard of Oz methodology. In this approach technologies that are not yet ready for testing by people are replaced by a human, both for prototyping and collecting additional dialogue data. In the case of Companions we want to observe what it would be like for people interact with a fully functional embodied conversational agent (ECA) and to collect samples of typical dialogue in order to explore, evaluate and model dialogue strategies. One controversial aspect of the Wizard of Oz approach is whether people should be aware that they are interacting with a simulation or whether they should be "fooled" into thinking they are interacting with a real system. Clearly there are ethical issues involved in fooling people, but some argue that unless the participant believes the simulation to be real, the results of any experimentation will not be applicable to the real situation. Over the course of several previous Wizard of Oz experiments our observations suggest that the dialogues produced do not significantly differ whether the participants know that the technology is faked or not. This hypothesis was investigated by collecting dialogues from two groups of participants. One group of participants believed that the Wizard of Oz speech system was in fact a fully computerised prototype and the other group knew that they would be talking through the interface to a hidden person (the wizard). The dialogues were analysed for differences attributable to the participants' beliefs about the system. This analysis was undertaken by an independent "blind" reviewer, a dialogue expert who attempted to allocate participants to one group or the other. His guess was wrong for four out of the six participants. Thus it appears that whether people believe they are interacting with a real system or not does not effect the dialogues and other factors, for example the personality of the person engaged in a dialogue with an ECA, are more important.