ACM Computing Surveys (CSUR)
Natural Computation
Imitation in animals and artifacts
Imitation in animals and artifacts
Segmentation Using Eigenvectors: A Unifying View
ICCV '99 Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2
Multimodal dynamics: self-supervised learning in perceptual and motor systems
Multimodal dynamics: self-supervised learning in perceptual and motor systems
Self-supervised acquisition of vowels in American English
AAAI'06 proceedings of the 21st national conference on Artificial intelligence - Volume 2
AAAI'05 Proceedings of the 20th national conference on Artificial intelligence - Volume 2
Multimodal integration: a biological view
IJCAI'01 Proceedings of the 17th international joint conference on Artificial intelligence - Volume 2
| Hi-index | 0.00 |
This paper presents a new framework for self-supervised sensorimotor learning. We demonstrate this framework with a system that learns to mimic a zebra finch, directly modeled on the dynamics of how male fledglings acquire birdsong from their fathers. Our system first listens to the song of an adult finch. By listening to its own initially nascent attempts at mimicry through an articulatory synthesizer, the system organizes motor maps generating its vocalizations. Our approach is founded on the notion of cross-modal clustering, introduced in (Coen 2005, 2006a), and is unusual for its recursive reuse of perceptual mechanisms in developing motor control. In this paper, we outline this framework, present its results on the unsupervised acquisition of birdsong, and discuss other potential applications.