Exploiting a sensed environment to improve human-agent communication

Authors:
Shana Watters;Tim Miller;Praveen Balachandran;William Schuler;Richard Voyles
Affiliations:
University of Minnesota, Minneapolis, MN;University of Minnesota, Minneapolis, MN;University of Minnesota, Minneapolis, MN;University of Minnesota, Minneapolis, MN;University of Minnesota, Minneapolis, MN
Venue:
Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems
Year:
2005

Citing 12
Cited 1

A model for reasoning about persistence and causation

Computational Intelligence
Integrating active perception with an autonomous robot architecture

AGENTS '98 Proceedings of the second international conference on Autonomous agents
The Theory of Parsing, Translation, and Compiling

The Theory of Parsing, Translation, and Compiling
Visual Event Classification via Force Dynamics

Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence
Matching words and pictures

The Journal of Machine Learning Research
Incremental interpretation of Categorial Grammar

EACL '95 Proceedings of the seventh conference on European chapter of the Association for Computational Linguistics
Finite-state approximation of phrase structure grammars

ACL '91 Proceedings of the 29th annual meeting on Association for Computational Linguistics
Integrating Perception, Language and Problem Solving in a Cognitive Agent for a Mobile Robot

AAMAS '04 Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems - Volume 3
MATCH: an architecture for multimodal dialogue systems

ACL '02 Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
Using model-theoretic semantic interpretation to guide statistical parsing and word recognition in a spoken language interface

ACL '03 Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1
Interpreting vague utterances in context

COLING '04 Proceedings of the 20th international conference on Computational Linguistics
Grounded semantic composition for visual scenes

Journal of Artificial Intelligence Research

Designing Izbushka: Investigating Interactions in Context Zero Environments

International Journal of Agent Technologies and Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes an implemented robotic agent architecture in which the environment, as sensed by the agent, is used to guide the recognition of spoken and gestural directives given by a human user. The agent recognizes these directives using a probabilistic language model that conditions probability estimates for possible directives on visually-, proprioceptively-, or otherwise-sensed properties of entities in its environment, and updates these probabilities when these properties change. The result is an agent that can discriminate against mis-recognized directives that do not 'make sense' in its representation of the current state of the world.