The Cyber Rodent Project: Exploration of Adaptive Mechanisms for Self-Preservation and Self-Reproduction

Authors:
Kenji Doya;Eiji Uchibe
Affiliations:
Initial Research Project, Okinawa Institute of Science and Technology, Japan/ ATR Computational Neuroscience Laboratories/ CREST, Japan Science and Technology Agency;Initial Research Project, Okinawa Institute of Science and Technology, Japan
Venue:
Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
Year:
2005

Citing 8
Cited 13

Between MDPs and semi-MDPs: a framework for temporal abstraction in reinforcement learning

Artificial Intelligence
Introduction to Reinforcement Learning

Introduction to Reinforcement Learning
Metalearning and neuromodulation

Neural Networks - Computational models of neuromodulation
Policy Invariance Under Reward Transformations: Theory and Application to Reward Shaping

ICML '99 Proceedings of the Sixteenth International Conference on Machine Learning
Evolution of reinforcement learning in uncertain environments: a simple explanation for complex foraging behaviors

Adaptive Behavior
Evolution of Neural Architecture Fitting Environmental Dynamics

Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
Hierarchical reinforcement learning with the MAXQ value function decomposition

Journal of Artificial Intelligence Research
An evolutionary approach to automatic construction of the structure in hierarchical reinforcement learning

GECCO'03 Proceedings of the 2003 international conference on Genetic and evolutionary computation: PartI

Finding Exploratory Rewards by Embodied Evolution and Constrained Reinforcement Learning in the Cyber Rodents

Neural Information Processing
Detection of Weak Signals by Emotion-Derived Stochastic Resonance

SAB '08 Proceedings of the 10th international conference on Simulation of Adaptive Behavior: From Animals to Animats
Co-evolution of Shaping Rewards and Meta-Parameters in Reinforcement Learning

Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
The Neuromodulatory System: A Framework for Survival and Adaptive Behavior in a Challenging World

Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
2008 Special Issue: Finding intrinsic rewards by embodied evolution and constrained reinforcement learning

Neural Networks
Co-evolution of Rewards and Meta-parameters in Embodied Evolution

Creating Brain-Like Intelligence
Neural Pathways of Embodied Simulation

Anticipatory Behavior in Adaptive Learning Systems
Emergence of Different Mating Strategies in Artificial Embodied Evolution

ICONIP '09 Proceedings of the 16th International Conference on Neural Information Processing: Part II
Free-energy based reinforcement learning for vision-based navigation with high-dimensional sensory inputs

ICONIP'10 Proceedings of the 17th international conference on Neural information processing: theory and algorithms - Volume Part I
Darwinian embodied evolution of the learning ability for survival

Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
An adaptive robot motivational system

SAB'06 Proceedings of the 9th international conference on From Animals to Animats: simulation of Adaptive Behavior
Experimental study on task teaching to real rats through interaction with a robotic rat

SAB'06 Proceedings of the 9th international conference on From Animals to Animats: simulation of Adaptive Behavior
From modulated Hebbian plasticity to simple behavior learning through noise and weight saturation

Neural Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

The aim of the Cyber Rodent project is to understand the origins of our reward and affective systems by building artificial agents that share the same intrinsic constraints as natural agents: Self-preserva tion and self-reproduction. A Cyber Rodent is a robot that can search for and recharge from battery packs on the floor and copy its programs to a nearby agent through its infrared communication port. This article reviews our research topics so far, including (1) evolution of neural controllers, (2) learning of foraging and mating behaviors, (3) evolution of learning architectures and meta-parameters, (4) simultaneous learning of multiple agents in a body, and (5) learning and evolution in a self-sustained colony. We discuss our future directions and expected contributions.