What to do and how to do it: translating natural language directives into temporal and dynamic logic representation for goal management and action execution

Authors:
Juraj Dzifcak;Matthias Scheutz;Chitta Baral;Paul Schermerhorn
Affiliations:
ASU;Indiana University;ASU;Indiana University
Venue:
ICRA'09 Proceedings of the 2009 IEEE international conference on Robotics and Automation
Year:
2009

Citing 7
Cited 13

Temporal and modal logic

Handbook of theoretical computer science (vol. B)
The syntactic process

The syntactic process
Planning for temporally extended goals

Annals of Mathematics and Artificial Intelligence
The Dynamic Predictive Memory Architecture: Integrating Language with Task Execution

INTSYS '98 Proceedings of the IEEE International Joint Symposia on Intelligence and Systems
Incremental natural language processing for HRI

Proceedings of the ACM/IEEE international conference on Human-robot interaction
Using answer set programming and lambda calculus to characterize natural language sentences with normatives and exceptions

AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 2
Computational complexity of planning with temporal goals

IJCAI'01 Proceedings of the 17th international joint conference on Artificial intelligence - Volume 1

Finding and exploiting goal opportunities in real-time during plan execution

IROS'09 Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems
Following directions using statistical machine translation

Proceedings of the 5th ACM/IEEE international conference on Human-robot interaction
Toward understanding natural language directions

Proceedings of the 5th ACM/IEEE international conference on Human-robot interaction
Robust spoken instruction understanding for HRI

Proceedings of the 5th ACM/IEEE international conference on Human-robot interaction
Planning for human-robot teaming in open worlds

ACM Transactions on Intelligent Systems and Technology (TIST)
A survey of motivation frameworks for intelligent systems

Artificial Intelligence
Facilitating mental modeling in collaborative human-robot interaction through adverbial cues

SIGDIAL '11 Proceedings of the SIGDIAL 2011 Conference
The inverse lambda calculus algorithm for typed first order logic lambda calculus and its application to translating english to FOL

Correct Reasoning
Toward learning perceptually grounded word meanings from unaligned parallel data

SIAC '12 Proceedings of the Second Workshop on Semantic Interpretation in an Actionable Context
Typed answer set programming lambda calculus theories and correctness of inverse lambda algorithms with respect to them

Theory and Practice of Logic Programming
Creating an artificially intelligent director (aid) for theatre and virtual environments

Proceedings of the 2013 international conference on Autonomous agents and multi-agent systems
An essential language for declarative business rules

Proceedings of the 3rd Computer Science Education Research Conference on Computer Science Education Research
Learning perceptually grounded word meanings from unaligned parallel data

Machine Learning

Quantified Score

Hi-index	0.00

Visualization

Abstract

Robots that can be given instructions in spoken language need to be able to parse a natural language utterance quickly, determine its meaning, generate a goal representation from it, check whether the new goal conflicts with existing goals, and if acceptable, produce an action sequence to achieve the new goal (ideally being sensitive to the existing goals). In this paper, we describe an integrated robotic architecture that can achieve the above steps by translating natural language instructions incrementally and simultaneously into formal logical goal description and action languages, which can be used both to reason about the achievability of a goal as well as to generate new action scripts to pursue the goal. We demonstrate the implementation of our approach on a robot taking spoken natural language instructions in an office environment.