Cross-modal clustering

Authors:
Michael H. Coen
Affiliations:
MIT Computer Science and Artificial Intelligence Laboratory, Cambridge, MA
Venue:
AAAI'05 Proceedings of the 20th national conference on Artificial intelligence - Volume 2
Year:
2005

Citing 5
Cited 5

Self-organization and associative memory: 3rd edition

Self-organization and associative memory: 3rd edition
Speech recognition by machines and humans

Speech Communication
Statistical methods for speech recognition

Statistical methods for speech recognition
Natural Computation

Natural Computation
How Many Clusters? An Information-Theoretic Perspective

Neural Computation

Self-supervised acquisition of vowels in American English

AAAI'06 proceedings of the 21st national conference on Artificial intelligence - Volume 2
Learning to sing like a bird: self-supervised acquisition of birdsong

AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 2
Multi-view clustering with constraint propagation for learning with an incomplete mapping between views

CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
A dynamic unsupervised laterally connected neural network architecture for integrative pattern discovery

ICONIP'11 Proceedings of the 18th international conference on Neural Information Processing - Volume Part II
Computational modeling of phonetic and lexical learning in early language acquisition: Existing models and future directions

Speech Communication

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a self-supervised algorithm for learning perceptual structures based upon correlations in different sensory modalities. The brain and cognitive sciences have gathered an enormous body of neurological and phenomenological evidence in the past half century that demonstrates the extraordinary degree of interaction between sensory modalities during the course of ordinary perception. This paper presents a new framework for creating artificial perceptual systems inspired by these findings, where the primary architectural motif is the cross-modal transmission of perceptual information to enhance each sensory channel individually. The basic hypothesis underlying this approach is that the world has regularities - natural laws tend to correlate physical properties - and biological perceptory systems have evolved to take advantage of this. They share information continually and opportunistically across seemingly disparate perceptual channels, not epiphenomenologically, but rather as a fundamental component of normal perception. It is therefore essential that their artificial counterparts be able to share information synergistically within their perceptual channels, if they are to approach degrees of biological sophistication. This paper is a preliminary step in that direction.