CNLS '89 Proceedings of the ninth annual international conference of the Center for Nonlinear Studies on Self-organizing, Collective, and Cooperative Phenomena in Natural and Artificial Computing Networks on Emergent computation
Recursive distributed representations
Artificial Intelligence - On connectionist symbol processing
Machine Learning - Special issue on inductive transfer
Learning Semantic Combinatoriality from the Interaction between Linguistic and Behavioral Processes
Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
Neural Networks - 2004 Special issue: New developments in self-organizing systems
Modeling tool-body assimilation using second-order recurrent neural network
IROS'09 Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems
SAB'10 Proceedings of the 11th international conference on Simulation of adaptive behavior: from animals to animats
Integrative learning between language and action: a neuro-robotics experiment
ICANN'10 Proceedings of the 20th international conference on Artificial neural networks: Part II
The learning of adjectives and nouns from affordance and appearance features
Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
| Hi-index | 0.00 |
Although many researchers have suggested that compositional concepts should be sensorimotor grounded, the method to accomplish this remains unclear. This article introduces a second-order neural network with parametric biases (sNNPB) that learns compositional structures based on sensorimotor time series data. The data was produced by a simulated robot that executed distinct object interactions (move-to and orient-toward). We show that various sNNPB setups can learn to compositionally imitate object interactions beyond the interactions that were specifically trained, which was not possible with previous neural network (NN) architectures, including recurrent neural networks (RNNs). We also show that these imitation capabilities are accomplished by developing a self-organized, geometrically arranged compositional concept structure in the PB values and task-oriented, Braitenberg-like sensory encodings in hidden sensory layers. Because second-order connections were necessary to accomplish the task, we hypothesize that such connections may be essential to drive the learning of both sensorimotor-grounded compositional structures and Braitenberg-like, behavior-oriented ''pro-presentations.'' From a cognitive perspective, we show how sensorimotor time series of interactions may be processed to generate the signals necessary to develop semantically compositional structures.