CHI '91 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Interaction Design: Beyond Human Computer Interaction
Interaction Design: Beyond Human Computer Interaction
Software tutors for dialogue systems
TSD'05 Proceedings of the 8th international conference on Text, Speech and Dialogue
Multimodal Interaction for Mobile Learning
UAHCI '09 Proceedings of the 5th International on ConferenceUniversal Access in Human-Computer Interaction. Part II: Intelligent and Ubiquitous Interaction Environments
| Hi-index | 0.00 |
We discuss the design of speech-based interaction systems from the perspective of affordance. It is our claim that many of the problems associated with speech interaction stems from a lack of a deeper understanding of the communicative nature of speech in combination with graphical interfaces. Today's graphical interfaces are almost universally based on the Direct Manipulation (DM) interaction paradigm, whereas speech interaction is in nature conversational. However, most multi modal systems accepting spoken input are designed with the DM paradigm as the underlying interaction model, often forcing the spoken input to correspond to simple commands, which are replicated in the GUI anyway. We will discuss how speech-based interfaces can be designed, taking into account that the DM paradigm is not supported by speech. We demonstrate this through the design of a concrete application for a portable device (PDA), and show how an underlying architecture can be built to support both spoken input and DM interfaces.