Responding to subtle, fleeting changes in the user's internal state

Authors:
Wataru Tsukahara;Nigel Ward
Affiliations:
Hitachi Central Research Labs, 1-280 Higashi-Koigakubo, Kokubunji-shi, Tokyo 185-8601 Japan;Mech-Info Engineering, University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656 Japan
Venue:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Year:
2001

Citing 12
Cited 16

Intelligence without representation

Artificial Intelligence
There was a long pause: influencing turn-taking behaviour in human-human and human-computer spoken dialogues

International Journal of Human-Computer Studies
Designing SpeechActs: issues in speech user interfaces

CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The persona effect: affective impact of animated pedagogical agents

Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
Affective computing

Affective computing
Embodiment in conversational interfaces: Rea

Proceedings of the SIGCHI conference on Human Factors in Computing Systems
The effects of animated characters on anxiety, task performance, and evaluations of user interfaces

Proceedings of the SIGCHI conference on Human Factors in Computing Systems
The limits of speech recognition

Communications of the ACM
Human conversation as a system framework: designing embodied conversational agents

Embodied conversational agents
Emotion and personality in a conversational agent

Embodied conversational agents
User-Centered Modeling for Spoken Language and Multimodal Interfaces

IEEE MultiMedia
AutoTutor: A simulation of a human tutor

Cognitive Systems Research

Voice as sound: using non-verbal voice input for interactive control

Proceedings of the 14th annual ACM symposium on User interface software and technology
Beyond task completion: evaluation of affective components of use

The human-computer interaction handbook
Interaction techniques using prosodic features of speech and audio localization

Proceedings of the 10th international conference on Intelligent user interfaces
2005 Special Issue: Beyond emotion archetypes: Databases for emotion modelling using neural networks

Neural Networks - Special issue: Emotion and brain
An attempt to enhance conversation in CSCL text chat by displaying learners' typing process

WBED'07 Proceedings of the sixth conference on IASTED International Conference Web-Based Education - Volume 2
Investigating Human Tutor Responses to Student Uncertainty for Adaptive System Development

ACII '07 Proceedings of the 2nd international conference on Affective Computing and Intelligent Interaction
Adapting to Student Uncertainty Improves Tutoring Dialogues

Proceedings of the 2009 conference on Artificial Intelligence in Education: Building Learning Systems that Care: From Knowledge Representation to Affective Modelling
Spoken tutorial dialogue and the feeling of another's knowing

SIGDIAL '09 Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue
An attempt to enhance conversation by dialog act display and real-time typing display in the "reach" chat tool

WBE '08 Proceedings of the Seventh IASTED International Conference on Web-based Education
Designing and evaluating a wizarded uncertainty-adaptive spoken dialogue tutoring system

Computer Speech and Language
Benefits and challenges of real-time uncertainty detection and adaptation in a spoken dialogue computer tutor

Speech Communication
Metacognition and learning in spoken dialogue computer tutoring

ITS'10 Proceedings of the 10th international conference on Intelligent Tutoring Systems - Volume Part I
Listener agent for elderly people with dementia

HRI '12 Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot Interaction
Intrinsic and extrinsic evaluation of an automatic user disengagement detector for an uncertainty-adaptive spoken dialogue system

NAACL HLT '12 Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Adapting to multiple affective states in spoken dialogue

SIGDIAL '12 Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Towards assessing the communication responsiveness of people with dementia

IVA'12 Proceedings of the 12th international conference on Intelligent Virtual Agents

Quantified Score

Hi-index	0.01

Visualization

Abstract

In human-to-human interaction, people sometimes are able to pick up and respond sensitively to the other's internal state as it shifts moment by moment over the course of an exchange. To find out whether such an ability is worthwhile for computer human interfaces, we built a semi-automated tutoring-type spoken dialog system. The system inferred information about the user's \scare{ephemeral emotions}, such as confidence, confusion, pleasure, and dependency, from the prosody of his utterances and the context. It used this information to select the most appropriate acknowledgement form at each moment. In doing so the system was following some of the basic social conventions for real-time interaction. Users rated the system with this ability more highly than a version without.