Affordance based word-to-meaning association
ICRA'09 Proceedings of the 2009 IEEE international conference on Robotics and Automation
How to use the SOINN software: user's guide (version 1.0)
ICANN'10 Proceedings of the 20th international conference on Artificial neural networks: Part III
Self-organizing incremental neural network and its application
ICANN'10 Proceedings of the 20th international conference on Artificial neural networks: Part III
| Hi-index | 0.00 |
We present a new approach for online incremental word acquisition and grammar learning by humanoid robots. Using no data set provided in advance, the proposed system grounds language in a physical context, as mediated by its perceptual capacities. It is carried out using show-and-tell procedures, interacting with its human partner. Moreover, this procedure is open-ended for new words and multiword utterances. These facilities are supported by a self-organizing incremental neural network, which can execute online unsupervised classification and topology learning. Embodied with a mental imagery, the system also learns by both top-down and bottom-up processes, which are the syntactic structures that are contained in utterances. Thereby, it performs simple grammar learning. Under such a multimodal scheme, the robot is able to describe online a given physical context (both static and dynamic) through natural language expressions. It can also perform actions through verbal interactions with its human partner.