Artificial intelligence and mathematical theory of computation
The independent choice logic for modelling multiple agents under uncertainty
Artificial Intelligence - Special issue on economic principles of multi-agent systems
Some contributions to the metatheory of the situation calculus
Journal of the ACM (JACM)
Stochastic dynamic programming with factored representations
Artificial Intelligence
Knowlege in action: logical foundations for specifying and implementing dynamical systems
Knowlege in action: logical foundations for specifying and implementing dynamical systems
Markov Decision Processes: Discrete Stochastic Dynamic Programming
Markov Decision Processes: Discrete Stochastic Dynamic Programming
Neuro-Dynamic Programming
Decision-Theoretic, High-Level Agent Programming in the Situation Calculus
Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence
Dynamic Programming
Reasoning about noisy sensors in the situation calculus
IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 2
SPUDD: stochastic planning using decision diagrams
UAI'99 Proceedings of the Fifteenth conference on Uncertainty in artificial intelligence
Mapping the Growing Neural Gas to Situation Calculus
ICANN '02 Proceedings of the International Conference on Artificial Neural Networks
ICML '04 Proceedings of the twenty-first international conference on Machine learning
Planning and programming with first-order markov decision processes: insights and challenges
TARK '01 Proceedings of the 8th conference on Theoretical aspects of rationality and knowledge
Exploiting first-order regression in inductive policy selection
UAI '04 Proceedings of the 20th conference on Uncertainty in artificial intelligence
Relational temporal difference learning
ICML '06 Proceedings of the 23rd international conference on Machine learning
θ-Subsumption Based on Object Context
Inductive Logic Programming
Synthesis of Optimal Control Policies for Some Infinite-State Transition Systems
MPC '08 Proceedings of the 9th international conference on Mathematics of Program Construction
A Logical Framework to Reinforcement Learning Using Hybrid Probabilistic Logic Programs
SUM '08 Proceedings of the 2nd international conference on Scalable Uncertainty Management
Reasoning about actions with sensing under qualitative and probabilistic uncertainty
ACM Transactions on Computational Logic (TOCL)
Practical solution techniques for first-order MDPs
Artificial Intelligence
Automatic construction of simple artifact-based business processes
Proceedings of the 12th International Conference on Database Theory
Probabilistic reasoning with answer sets
Theory and Practice of Logic Programming
An Inductive Logic Programming Approach to Statistical Relational Learning
Proceedings of the 2005 conference on An Inductive Logic Programming Approach to Statistical Relational Learning
Adaptive Multi-Agent Programming in GTGolog
Proceedings of the 2006 conference on ECAI 2006: 17th European Conference on Artificial Intelligence August 29 -- September 1, 2006, Riva del Garda, Italy
Decision tree methods for finding reusable MDP homomorphisms
AAAI'06 Proceedings of the 21st national conference on Artificial intelligence - Volume 1
Relevance Grounding for Planning in Relational Domains
ECML PKDD '09 Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases: Part I
Improving action selection in MDP's via knowledge transfer
AAAI'05 Proceedings of the 20th national conference on Artificial intelligence - Volume 2
Finding state similarities for faster planning
AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 2
Journal of Artificial Intelligence Research
FLUCAP: a heuristic search planner for first-order MDPs
Journal of Artificial Intelligence Research
Learning symbolic models of stochastic domains
Journal of Artificial Intelligence Research
First order decision diagrams for relational MDPs
Journal of Artificial Intelligence Research
Learning partially observable deterministic action models
Journal of Artificial Intelligence Research
First order decision diagrams for relational MDPs
IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Team programming in Golog under partial observability
IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Dynamic probabilistic relational models
IJCAI'03 Proceedings of the 18th international joint conference on Artificial intelligence
Intensional dynamic programming. A Rosetta stone for structured dynamic programming
Journal of Algorithms
Generalized first order decision diagrams for first order Markov decision processes
IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
Game-theoretic agent programming in Golog under partial observability
KI'06 Proceedings of the 29th annual German conference on Artificial intelligence
Adaptive multi-agent programming in GTGolog
KI'06 Proceedings of the 29th annual German conference on Artificial intelligence
Distributed AI for ambient intelligence: issues and approaches
AmI'07 Proceedings of the 2007 European conference on Ambient intelligence
Generating optimal plans in highly-dynamic domains
UAI '09 Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence
Exploration in relational worlds
ECML PKDD'10 Proceedings of the 2010 European conference on Machine learning and knowledge discovery in databases: Part II
Automatic induction of bellman-error features for probabilistic planning
Journal of Artificial Intelligence Research
Distributed redundancy and robustness in complex systems
Journal of Computer and System Sciences
Planning with noisy probabilistic relational rules
Journal of Artificial Intelligence Research
Relational preference rules for control
Artificial Intelligence
Dynamic selling of quality-graded products under demand uncertainties
Computers and Industrial Engineering
Logic, probability and computation: foundations and issues of statistical relational AI
LPNMR'11 Proceedings of the 11th international conference on Logic programming and nonmonotonic reasoning
ECSQARU'11 Proceedings of the 11th European conference on Symbolic and quantitative approaches to reasoning with uncertainty
Detecting and repairing anomalous evolutions in noisy environments
Annals of Mathematics and Artificial Intelligence
Decision-theoretic planning with generalized first-order decision diagrams
Artificial Intelligence
A partition-based first-order probabilistic logic to represent interactive beliefs
SUM'11 Proceedings of the 5th international conference on Scalable uncertainty management
SUM'11 Proceedings of the 5th international conference on Scalable uncertainty management
Probabilistic relational planning with first order decision diagrams
Journal of Artificial Intelligence Research
Inductive policy selection for first-order MDPs
UAI'02 Proceedings of the Eighteenth conference on Uncertainty in artificial intelligence
Game-theoretic reasoning about actions in nonmonotonic causal theories
LPNMR'05 Proceedings of the 8th international conference on Logic Programming and Nonmonotonic Reasoning
Unique state and automatical action abstracting based on logical MDPs with negation
ICNC'06 Proceedings of the Second international conference on Advances in Natural Computation - Volume Part II
Structure-based causes and explanations in the independent choice logic
UAI'03 Proceedings of the Nineteenth conference on Uncertainty in Artificial Intelligence
Imitation learning in relational domains: a functional-gradient boosting approach
IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Two
Integrating relational reinforcement learning with reasoning about actions and change
ILP'11 Proceedings of the 21st international conference on Inductive Logic Programming
Exploration in relational domains for model-based reinforcement learning
The Journal of Machine Learning Research
Robust optimization for hybrid MDPs with state-dependent noise
IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Hi-index | 0.00 |
We present a dynamic programming approach for the solution of first-order Markov decisions processes. This technique uses an MDP whose dynamics is represented in a variant of the situation calculus allowing for stochastic actions. It produces a logical description of the optimal value function and policy by constructing a set of first-order formulae that minimally partition state space according to distinctions made by the value function and policy. This is achieved through the use of an operation known as decision-theoretic regression. In effect, our algorithm performs value iteration without explicit enumeration of either the state or action spaces of the MDP. This allows problems involving relational fluents and quantification to be solved without requiring explicit state space enumeration or conversion to propositional form.