The Journal of Machine Learning Research
The mathematics of statistical machine translation: parameter estimation
Computational Linguistics - Special issue on using large corpora: II
A multimodal learning interface for grounding spoken language in sensory perceptions
ACM Transactions on Applied Perception (TAP)
Proceedings of the 13th international conference on Intelligent user interfaces
WordNet: similarity - measuring the relatedness of concepts
AAAI'04 Proceedings of the 19th national conference on Artifical intelligence
EMNLP '08 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Grounded semantic composition for visual scenes
Journal of Artificial Intelligence Research
The role of interactivity in human-machine conversation for automatic word acquisition
SIGDIAL '09 Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Utilizing visual attention for cross-modal coreference interpretation
CONTEXT'05 Proceedings of the 5th international conference on Modeling and Using Context
| Hi-index | 0.00 |
Most conversation systems tend to fail when unexpected words are encountered. To overcome this problem, conversational systems must be able to learn new words automatically during human machine conversation. Motivated by psycholinguistic findings on eye gaze and human language processing, we have developed several techniques to incorporate human eye gaze for automatic word acquisition in multimodal conversational systems. This paper presents our new results on integrating eye gaze and domain knowledge in word acquisition in a 3D virtual world application. Our results demonstrate that the incorporation of domain knowledge can potentially improve word acquisition performance.