Schemas that integrate vision and touch for hand control
Vision, brain, and cooperative computation
Intelligence without representation
Artificial Intelligence
Made-up minds: a constructivist approach to artificial intelligence
Made-up minds: a constructivist approach to artificial intelligence
Artificial intelligence and mobile robots
Mean Shift: A Robust Approach Toward Feature Space Analysis
IEEE Transactions on Pattern Analysis and Machine Intelligence
Understanding Natural Language
Understanding Natural Language
Shape Matching and Object Recognition Using Shape Contexts
IEEE Transactions on Pattern Analysis and Machine Intelligence
Guest Editors' Introduction: Semisentient Robots-- Routes to Integrated Intelligence
IEEE Intelligent Systems
Evaluating Integrated Speech- and Image Understanding
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Intelligence by design: principles of modularity and coordination for engineering complex adaptive agents
From first contact to close encounters: a developmentally deep perceptual system for a humanoid robot
Connecting language to the world
Artificial Intelligence - Special volume on connecting language to the world
Semiotic schemas: a framework for grounding language in action and perception
Artificial Intelligence - Special volume on connecting language to the world
Perspective taking: an organizing principle for learning in human-robot interaction
AAAI'06 proceedings of the 21st national conference on Artificial intelligence - Volume 2
Grounding the lexical semantics of verbs in visual perception using force dynamics and event logic
Journal of Artificial Intelligence Research
A layered brain architecture for synthetic creatures
IJCAI'01 Proceedings of the 17th international joint conference on Artificial intelligence - Volume 2
Modularity and design in reactive intelligence
IJCAI'01 Proceedings of the 17th international joint conference on Artificial intelligence - Volume 2
Spatial language for human-robot dialogs
IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Mental imagery for a conversational robot
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Following directions using statistical machine translation
Proceedings of the 5th ACM/IEEE international conference on Human-robot interaction
Toward learning perceptually grounded word meanings from unaligned parallel data
SIAC '12 Proceedings of the Second Workshop on Semantic Interpretation in an Actionable Context
Targets-Drives-Means: A declarative approach to dynamic behavior specification with higher usability
Robotics and Autonomous Systems
Hi-index | 0.00 |
An approach is introduced for physically grounded natural language interpretation by robots that reacts appropriately to unanticipated physical changes in the environment and dynamically assimilates new information pertinent to ongoing tasks. At the core of the approach is a model of object schemas that enables a robot to encode beliefs about physical objects in its environment using collections of coupled processes responsible for sensorimotor interaction. These interaction processes run concurrently in order to ensure responsiveness to the environment, while co-ordinating sensorimotor expectations, action planning and language use. The model has been implemented on a robot that manipulates objects on a tabletop in response to verbal input. The implementation responds to verbal requests such as 'Group the green block and the red apple', while adapting in real time to unexpected physical collisions and taking opportunistic advantage of any new information it may receive through perceptual and linguistic channels.