CNLS '89 Proceedings of the ninth annual international conference of the Center for Nonlinear Studies on Self-organizing, Collective, and Cooperative Phenomena in Natural and Artificial Computing Networks on Emergent computation
L0—the first five years of an automated language acquisition project
Artificial Intelligence Review - Special issue: grounding representations
Solving the multiple instance problem with axis-parallel rectangles
Artificial Intelligence
Foundations of statistical natural language processing
Foundations of statistical natural language processing
Text classification using string kernels
The Journal of Machine Learning Research
The Journal of Machine Learning Research
Stochastic inversion transduction grammars and bilingual parsing of parallel corpora
Computational Linguistics
Human Motion: Modeling and Recognition of Actions and Interactions
3DPVT '04 Proceedings of the 3D Data Processing, Visualization, and Transmission, 2nd International Symposium
Machine Learning in Computer Vision (Computational Imaging and Vision)
Machine Learning in Computer Vision (Computational Imaging and Vision)
Supervised versus multiple instance learning: an empirical comparison
ICML '05 Proceedings of the 22nd international conference on Machine learning
Word sense disambiguation with pictures
Artificial Intelligence - Special volume on connecting language to the world
A hierarchical phrase-based model for statistical machine translation
ACL '05 Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics
Using string-kernels for learning semantic parsers
ACL-44 Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics
Learning for semantic parsing with statistical machine translation
HLT-NAACL '06 Proceedings of the main conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics
Predicting Structured Data (Neural Information Processing)
Predicting Structured Data (Neural Information Processing)
Learning to sportscast: a test of grounded language acquisition
Proceedings of the 25th international conference on Machine learning
On the integration of grounding language and learning objects
AAAI'04 Proceedings of the 19th national conference on Artifical intelligence
Situated models of meaning for sports video retrieval
NAACL-Short '07 Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Companion Volume, Short Papers
Learning language semantics from ambiguous supervision
AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 1
Journal of Artificial Intelligence Research
A statistical semantic parser that integrates syntax and semantics
CONLL '05 Proceedings of the Ninth Conference on Computational Natural Language Learning
Intentional context in situated natural language learning
CONLL '05 Proceedings of the Ninth Conference on Computational Natural Language Learning
Learning to parse database queries using inductive logic programming
AAAI'96 Proceedings of the thirteenth national conference on Artificial intelligence - Volume 2
Reinforcement learning for mapping instructions to actions
ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1 - Volume 1
Following directions using statistical machine translation
Proceedings of the 5th ACM/IEEE international conference on Human-robot interaction
Reading between the lines: learning to map high-level instructions to commands
ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
Learning to win by reading manuals in a Monte-Carlo framework
HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
Learning high-level planning from text
ACL '12 Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Long Papers - Volume 1
| Hi-index | 0.00 |
To truly understand language, an intelligent system must be able to connect words, phrases, and sentences to its perception of objects and events in the world. Current natural language processing and computer vision systems make extensive use of machine learning to acquire the probabilistic knowledge needed to comprehend linguistic and visual input. However, to date, there has been relatively little work on learning the relationships between the two modalities. In this talk, I will review some of the existing work on learning to connect language and perception, discuss important directions for future research in this area, and argue that the time is now ripe to make a concerted effort to address this important, integrative AI problem.