Talking to computers: an empirical investigation
International Journal of Man-Machine Studies
The media equation: how people treat computers, television, and new media like real people and places
Task integration in multimodal speech recognition environments
Crossroads - Special issue on human computer interaction
Why do electronic conversations seem less polite? the costs and benefits of hedging
WACC '99 Proceedings of the international joint conference on Work activities coordination and collaboration
Automated instructor assistant for ship damage control
AAAI '99/IAAI '99 Proceedings of the sixteenth national conference on Artificial intelligence and the eleventh Innovative applications of artificial intelligence conference innovative applications of artificial intelligence
Ten myths of multimodal interaction
Communications of the ACM
Minimally Invasive Tutoring of Complex Physics Problem Solving
ITS '02 Proceedings of the 6th International Conference on Intelligent Tutoring Systems
An Intelligent Tutoring System Incorporating a Model of an Experienced Human Tutor
ITS '02 Proceedings of the 6th International Conference on Intelligent Tutoring Systems
A 3-Tier Planning Architecture for Managing Tutorial Dialogue
ITS '02 Proceedings of the 6th International Conference on Intelligent Tutoring Systems
Intelligent tutoring systems have forgotten the tutor: adding a cognitive model of human tutors
Intelligent tutoring systems have forgotten the tutor: adding a cognitive model of human tutors
Gemini: a natural language system for spoken-language understanding
ACL '93 Proceedings of the 31st annual meeting on Association for Computational Linguistics
Development of the HRL route navigation dialogue system
HLT '01 Proceedings of the first international conference on Human language technology research
Predicting student emotions in computer-human tutoring dialogues
ACL '04 Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics
Going Beyond the Problem Given: How Human Tutors Use Post-Solution Discussions to Support Transfer
International Journal of Artificial Intelligence in Education - "Caring for the Learner" in honour of John Self
Detecting emotion in speech: experiments in three domains
NAACL-DocConsortium '06 Proceedings of the 2006 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology: companion volume: doctoral consortium
Investigating Human Tutor Responses to Student Uncertainty for Adaptive System Development
ACII '07 Proceedings of the 2nd international conference on Affective Computing and Intelligent Interaction
Responding to Student Uncertainty During Computer Tutoring: An Experimental Evaluation
ITS '08 Proceedings of the 9th international conference on Intelligent Tutoring Systems
Be Brief, And They Shall Learn: Generating Concise Language Feedback for a Computer Tutor
International Journal of Artificial Intelligence in Education
Dialog Convergence and Learning
Proceedings of the 2007 conference on Artificial Intelligence in Education: Building Technology Rich Learning Contexts That Work
The Influence of Learner Characteristics on Task-Oriented Tutorial Dialogue
Proceedings of the 2007 conference on Artificial Intelligence in Education: Building Technology Rich Learning Contexts That Work
Exploiting discourse structure for spoken dialogue performance analysis
EMNLP '06 Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing
Exploring affect-context dependencies for adaptive system development
NAACL-Short '07 Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Companion Volume, Short Papers
The importance of sub-utterance prosody in predicting level of certainty
NAACL-Short '09 Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Companion Volume: Short Papers
Learner characteristics and feedback in tutorial dialogue
EANL '08 Proceedings of the Third Workshop on Innovative Use of NLP for Building Educational Applications
Adapting to Student Uncertainty Improves Tutoring Dialogues
Proceedings of the 2009 conference on Artificial Intelligence in Education: Building Learning Systems that Care: From Knowledge Representation to Affective Modelling
Evidence of Misunderstandings in Tutorial Dialogue and their Impact on Learning
Proceedings of the 2009 conference on Artificial Intelligence in Education: Building Learning Systems that Care: From Knowledge Representation to Affective Modelling
Spoken tutorial dialogue and the feeling of another's knowing
SIGDIAL '09 Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Designing and evaluating a wizarded uncertainty-adaptive spoken dialogue tutoring system
Computer Speech and Language
Using virtual tour behavior to build dialogue models for training review
IVA'11 Proceedings of the 10th international conference on Intelligent virtual agents
SIGDIAL '11 Proceedings of the SIGDIAL 2011 Conference
In the zone: towards detecting student zoning out using supervised machine learning
ITS'10 Proceedings of the 10th international conference on Intelligent Tutoring Systems - Volume Part II
Metacognition and learning in spoken dialogue computer tutoring
ITS'10 Proceedings of the 10th international conference on Intelligent Tutoring Systems - Volume Part I
NAACL HLT '12 Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
Recognizing Young Readers' Spoken Questions
International Journal of Artificial Intelligence in Education
Inducing and Tracking Confusion with Contradictions during Complex Learning
International Journal of Artificial Intelligence in Education - Best of AIED 2011
Hi-index | 0.00 |
In designing and building tutorial dialogue systems it is important not only to understand the tactics employed by human tutors but also to understand how tutors decide when to use various tactics. We argue that these decisions are based not only on student problem-solving steps and the content of student utterances, but also on the meta-communicative information conveyed through spoken utterances (e.g., pauses, disfluencies, intonation). Since this information is often infrequent or unavailable in typed input, tutorial dialogue systems with speech interfaces have the potential to be more effective than those without. This paper gives an overview of the Spoken Conversational Tutor (SCoT) that we have built and describes how we are beginning to make use of spoken language information in SCoT. Specifically, we describe a study aimed at using meta-communicative information to gauge student uncertainty and respond accordingly. In this study, we identify linguistic devices used by human tutors when responding to utterances containing signals of uncertainty, integrate these response strategies into two versions of SCoT, and evaluate their relative effectiveness. Our main hypothesis - that tutors are more effective if they use these linguistic devices in response to student uncertainty - was not confirmed, but our secondary hypothesis - that tutors using these linguistic devices are more effective than tutors that do not use them - was supported by the results.