Genetic algorithms with sharing for multimodal function optimization
Proceedings of the Second International Conference on Genetic Algorithms on Genetic algorithms and their application
An incremental genetic algorithms for real-time learning
Proceedings of the sixth international workshop on Machine learning
Learning internal representations by error propagation
Parallel distributed processing: explorations in the microstructure of cognition, vol. 1
Intelligent scheduling
TD-Gammon, a self-teaching backgammon program, achieves master-level play
Neural Computation
Learning and evolution in neural networks
Adaptive Behavior
Elevator Group Control Using Multiple Reinforcement Learning Agents
Machine Learning
Scheduling Algorithms for Multiprogramming in a Hard-Real-Time Environment
Journal of the ACM (JACM)
Gradient descent for general reinforcement learning
Proceedings of the 1998 conference on Advances in neural information processing systems II
Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control and Artificial Intelligence
Genetic Algorithms in Search, Optimization and Machine Learning
Genetic Algorithms in Search, Optimization and Machine Learning
Introduction to Reinforcement Learning
Introduction to Reinforcement Learning
Reinforced Genetic Programming
Genetic Programming and Evolvable Machines
Finite-time Analysis of the Multiarmed Bandit Problem
Machine Learning
Learning to Predict by the Methods of Temporal Differences
Machine Learning
Evolving neural networks through augmenting topologies
Evolutionary Computation
The Vision of Autonomic Computing
Computer
Learning Classifier Systems, From Foundations to Applications
Learning Classifier Systems, From Foundations to Applications
Practical Reinforcement Learning in Continuous Spaces
ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
Averaging Efficiently in the Presence of Noise
PPSN V Proceedings of the 5th International Conference on Parallel Problem Solving from Nature
Lamarckian Evolution, The Baldwin Effect and Function Optimization
PPSN III Proceedings of the International Conference on Evolutionary Computation. The Third Conference on Parallel Problem Solving from Nature: Parallel Problem Solving from Nature
PEGASUS: A policy search method for large MDPs and POMDPs
UAI '00 Proceedings of the 16th Conference on Uncertainty in Artificial Intelligence
Applications of the self-organising map to reinforcement learning
Neural Networks - New developments in self-organizing maps
Least-squares policy iteration
The Journal of Machine Learning Research
Priority Mechanisms for OLTP and Transactional Web Applications
ICDE '04 Proceedings of the 20th International Conference on Data Engineering
Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining
Utility Functions in Autonomic Systems
ICAC '04 Proceedings of the First International Conference on Autonomic Computing
Towards Self-Configuring Hardware for Distributed Computer Systems
ICAC '05 Proceedings of the Second International Conference on Automatic Computing
A comparison between cellular encoding and direct encoding for genetic neural networks
GECCO '96 Proceedings of the 1st annual conference on Genetic and evolutionary computation
Machine learning for fast quadrupedal locomotion
AAAI'04 Proceedings of the 19th national conference on Artifical intelligence
Samuel meets Amarel: automating value function approximation using global state space analysis
AAAI'05 Proceedings of the 20th national conference on Artificial intelligence - Volume 2
Competitive coevolution through evolutionary complexification
Journal of Artificial Intelligence Research
A reinforcement learning approach to job-shop scheduling
IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 2
Adaptive job routing and scheduling
Engineering Applications of Artificial Intelligence
ECML'05 Proceedings of the 16th European conference on Machine Learning
Function approximation via tile coding: automating parameter choice
SARA'05 Proceedings of the 6th international conference on Abstraction, Reformulation and Approximation
Bandit problems and the exploration/exploitation tradeoff
IEEE Transactions on Evolutionary Computation
Comparing evolutionary and temporal difference methods in a reinforcement learning domain
Proceedings of the 8th annual conference on Genetic and evolutionary computation
On-line evolutionary computation for reinforcement learning in stochastic domains
Proceedings of the 8th annual conference on Genetic and evolutionary computation
Proceedings of the 9th annual conference companion on Genetic and evolutionary computation
Empirical Studies in Action Selection with Reinforcement Learning
Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
Transfer via inter-task mappings in policy search reinforcement learning
Proceedings of the 6th international joint conference on Autonomous agents and multiagent systems
A survey of autonomic computing—degrees, models, and applications
ACM Computing Surveys (CSUR)
Proceedings of the 10th annual conference companion on Genetic and evolutionary computation
Online kernel selection for Bayesian reinforcement learning
Proceedings of the 25th international conference on Machine learning
Analysis of an evolutionary reinforcement learning method in a multiagent domain
Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 1
Evolution Strategies for Direct Policy Search
Proceedings of the 10th international conference on Parallel Problem Solving from Nature: PPSN X
Evolving Neural Networks for Online Reinforcement Learning
Proceedings of the 10th international conference on Parallel Problem Solving from Nature: PPSN X
Co-evolution of Shaping Rewards and Meta-Parameters in Reinforcement Learning
Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
Experimental analysis of eligibility traces strategies in temporal difference learning
International Journal of Knowledge Engineering and Soft Data Paradigms
Simulation and reinforcement learning with soccer agents
Multiagent and Grid Systems - Innovations in intelligent agent technology
Reinforcement Learning: A Tutorial Survey and Recent Advances
INFORMS Journal on Computing
Fuzzy CMAC with automatic state partition for reinforcementlearning
Proceedings of the first ACM/SIGEVO Summit on Genetic and Evolutionary Computation
Hoeffding and Bernstein races for selecting policies in evolutionary direct policy search
ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
An empirical analysis of value function-based and policy search reinforcement learning
Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems - Volume 2
A Simulation-based Approach for Solving Generalized Semi-Markov Decision Processes
Proceedings of the 2008 conference on ECAI 2008: 18th European Conference on Artificial Intelligence
Neuroevolutionary reinforcement learning for generalized helicopter control
Proceedings of the 11th Annual conference on Genetic and evolutionary computation
Uncertainty handling CMA-ES for reinforcement learning
Proceedings of the 11th Annual conference on Genetic and evolutionary computation
Proceedings of the 11th Annual Conference Companion on Genetic and Evolutionary Computation Conference: Late Breaking Papers
Sample-efficient evolutionary function approximation for reinforcement learning
AAAI'06 Proceedings of the 21st national conference on Artificial intelligence - Volume 1
Temporal difference and policy search methods for reinforcement learning: an empirical comparison
AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 2
Autonomous inter-task transfer in reinforcement learning domains
AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 2
Stochastic optimization for collision selection in high energy physics
IAAI'07 Proceedings of the 19th national conference on Innovative applications of artificial intelligence - Volume 2
Learning and multiagent reasoning for autonomous agents
IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Neuroevolution strategies for episodic reinforcement learning
Journal of Algorithms
Machine learning for event selection in high energy physics
Engineering Applications of Artificial Intelligence
Temporal difference learning with interpolated table value functions
CIG'09 Proceedings of the 5th international conference on Computational Intelligence and Games
Evolution versus temporal difference learning for learning to play Ms. Pac-Man
CIG'09 Proceedings of the 5th international conference on Computational Intelligence and Games
Investigating the emergence of phenotypic plasticity in evolving digital organisms
ECAL'07 Proceedings of the 9th European conference on Advances in artificial life
IEEE Transactions on Evolutionary Computation
Autonomous Agents and Multi-Agent Systems
Autonomous Agents and Multi-Agent Systems
Revising the evolutionary computation abstraction: minimal criteria novelty search
Proceedings of the 12th annual conference on Genetic and evolutionary computation
Proceedings of the 12th annual conference companion on Genetic and evolutionary computation
Reinforcement learning of competitive and cooperative skills in soccer agents
Applied Soft Computing
A NEAT Way for Evolving Echo State Networks
Proceedings of the 2010 conference on ECAI 2010: 19th European Conference on Artificial Intelligence
Evolving plastic neural networks with novelty search
Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
Darwinian embodied evolution of the learning ability for survival
Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
Abandoning objectives: Evolution through the search for novelty alone
Evolutionary Computation
Coupled inverted pendulums: a benchmark for evolving decentral controllers in modular robotics
Proceedings of the 13th annual conference on Genetic and evolutionary computation
On the deleterious effects of a priori objectives on evolution and representation
Proceedings of the 13th annual conference on Genetic and evolutionary computation
Proceedings of the 13th annual conference companion on Genetic and evolutionary computation
Computational Intelligence
Impact of neuron models and network structure on evolving modular robot neural network controllers
Proceedings of the 14th annual conference on Genetic and evolutionary computation
Sample aware embedded feature selection for reinforcement learning
Proceedings of the 14th annual conference on Genetic and evolutionary computation
CMA-TWEANN: efficient optimization of neural networks via self-adaptation and seamless augmentation
Proceedings of the 14th annual conference on Genetic and evolutionary computation
Accelerating evolution via egalitarian social learning
Proceedings of the 14th annual conference on Genetic and evolutionary computation
Breast cancer detection using cartesian genetic programming evolved artificial neural networks
Proceedings of the 14th annual conference on Genetic and evolutionary computation
Transferring evolved reservoir features in reinforcement learning tasks
EWRL'11 Proceedings of the 9th European conference on Recent Advances in Reinforcement Learning
Multiagent learning through neuroevolution
WCCI'12 Proceedings of the 2012 World Congress conference on Advances in Computational Intelligence
Adaptive reservoir computing through evolution and learning
Neurocomputing
Transferring task models in Reinforcement Learning agents
Neurocomputing
Proceedings of the 15th annual conference companion on Genetic and evolutionary computation
Adaptive function approximation in reinforcement learning with an interpolating growing neural gas
International Journal of Hybrid Intelligent Systems
Mimicking human neuronal pathways in silico: an emergent model on the effective connectivity
Journal of Computational Neuroscience
Hi-index | 0.00 |
Temporal difference methods are theoretically grounded and empirically effective methods for addressing reinforcement learning problems. In most real-world reinforcement learning tasks, TD methods require a function approximator to represent the value function. However, using function approximators requires manually making crucial representational decisions. This paper investigates evolutionary function approximation, a novel approach to automatically selecting function approximator representations that enable efficient individual learning. This method evolves individuals that are better able to learn. We present a fully implemented instantiation of evolutionary function approximation which combines NEAT, a neuroevolutionary optimization technique, with Q-learning, a popular TD method. The resulting NEAT+Q algorithm automatically discovers effective representations for neural network function approximators. This paper also presents on-line evolutionary computation, which improves the on-line performance of evolutionary computation by borrowing selection mechanisms used in TD methods to choose individual actions and using them in evolutionary computation to select policies for evaluation. We evaluate these contributions with extended empirical studies in two domains: 1) the mountain car task, a standard reinforcement learning benchmark on which neural network function approximators have previously performed poorly and 2) server job scheduling, a large probabilistic domain drawn from the field of autonomic computing. The results demonstrate that evolutionary function approximation can significantly improve the performance of TD methods and on-line evolutionary computation can significantly improve evolutionary methods. This paper also presents additional tests that offer insight into what factors can make neural network function approximation difficult in practice.