Netman: a learning network traffic controller
IEA/AIE '90 Proceedings of the 3rd international conference on Industrial and engineering applications of artificial intelligence and expert systems - Volume 2
Recent Advances in Hierarchical Reinforcement Learning
Discrete Event Dynamic Systems
Learning Options in Reinforcement Learning
Proceedings of the 5th International Symposium on Abstraction, Reformulation and Approximation
Model Minimization in Hierarchical Reinforcement Learning
Proceedings of the 5th International Symposium on Abstraction, Reformulation and Approximation
From Shell Logs to Shell Scripts
ILP '01 Proceedings of the 11th International Conference on Inductive Logic Programming
Recent Advances in Hierarchical Reinforcement Learning
Discrete Event Dynamic Systems
Speedup learning for repair-based search by identifying redundant steps
The Journal of Machine Learning Research
An Architecture for Persistent Reactive Behavior
AAMAS '04 Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems - Volume 2
Learning Recursive Control Programs from Problem Solving
The Journal of Machine Learning Research
Regression for Classical and Nondeterministic Planning
Proceedings of the 2008 conference on ECAI 2008: 18th European Conference on Artificial Intelligence
WoLLIC '09 Proceedings of the 16th International Workshop on Logic, Language, Information and Computation
Learning and applying competitive strategies
AAAI'04 Proceedings of the 19th national conference on Artifical intelligence
POIROT: acquiring workflows by combining models learned from interpreted traces
Proceedings of the fifth international conference on Knowledge capture
POIROT: integrated learning of web service procedures
AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 3
Macro-FF: improving AI planning with automatically learned macro-operators
Journal of Artificial Intelligence Research
Iterative optimization and simplification of hierarchical clusterings
Journal of Artificial Intelligence Research
A selective macro-learning algorithm and its application to the N × N sliding-tile puzzle
Journal of Artificial Intelligence Research
Fast planning with iterative macros
IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
SMDP homomorphisms: an algebraic approach to abstraction in semi-Markov decision processes
IJCAI'03 Proceedings of the 18th international joint conference on Artificial intelligence
A reinforcement learning model using macro-actions in multi-task grid-world problems
SMC'09 Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics
Finding and transferring policies using stored behaviors
Autonomous Robots
The Knowledge Engineering Review
Implicit Learning of Compiled Macro-Actions for Planning
Proceedings of the 2010 conference on ECAI 2010: 19th European Conference on Artificial Intelligence
Learning search control for constraint-based scheduling
AAAI'90 Proceedings of the eighth National conference on Artificial intelligence - Volume 2
SteppingStone: an empirical and analytical evaluation
AAAI'91 Proceedings of the ninth National conference on Artificial intelligence - Volume 2
Reinforcement learning with a hierarchy of abstract models
AAAI'92 Proceedings of the tenth national conference on Artificial intelligence
Machine learning for intelligent systems
AAAI'97/IAAI'97 Proceedings of the fourteenth national conference on artificial intelligence and ninth conference on Innovative applications of artificial intelligence
Bee behaviour in multi-agent systems: a bee foraging algorithm
ALAMAS'05/ALAMAS'06/ALAMAS'07 Proceedings of the 5th , 6th and 7th European conference on Adaptive and learning agents and multi-agent systems: adaptation and multi-agent learning
Automatic discovery of subgoals for sequential decision problems using potential fields
ICNC'05 Proceedings of the First international conference on Advances in Natural Computation - Volume Part III
Learning teleoreactive logic programs from problem solving
ILP'05 Proceedings of the 15th international conference on Inductive Logic Programming
Cognitive Systems Research
Acquisition of hierarchical reactive skills in a unified cognitive architecture
Cognitive Systems Research
Refining incomplete planning domain models through plan traces
IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
| Hi-index | 0.00 |
This paper describes a heuristic approach to the discovery of useful macro-operators (macros) in problem solving. The approach has been implemented in a program, MACLEARN, that has three parts: macro-proposer, static filter, and dynamic filter. Learning occurs during problem solving, so that performance improves in the course of a single problem trial. Primitive operators and macros are both represented within a uniform representational framework that is closed under composition. This means that new macros can be defined in terms of others, which leads to a definitional hierarchy. The representation also supports the transfer of macros to related problems. MACLEARN is embedded in a supporting system that carries out best-first search. Experiments in macro learning were conducted for two classes of problems: peg solitaire (generalized “Hi-Q puzzle”), and tile sliding (generalized “Fifteen puzzle”). The results indicate that MACLEARN'S filtering heuristics all improve search performance, sometimes dramatically. When the system was given practice on simpler training problems, it learned a set of macros that led to successful solutions of several much harder problems.