A Cache-Based Natural Language Model for Speech Recognition
IEEE Transactions on Pattern Analysis and Machine Intelligence
Artificial Intelligence - On connectionist symbol processing
Unsupervised learning by probabilistic latent semantic analysis
Machine Learning
Explorations in Automatic Thesaurus Discovery
Explorations in Automatic Thesaurus Discovery
The Journal of Machine Learning Research
Probabilistic top-down parsing and language modeling
Computational Linguistics
Exploiting syntactic structure for language modeling
COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 1
Immediate-head parsing for language models
ACL '01 Proceedings of the 39th Annual Meeting on Association for Computational Linguistics
Latent semantic information in maximum entropy language models for conversational speech recognition
NAACL '03 Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - Volume 1
COLING '04 Proceedings of the 20th international conference on Computational Linguistics
Dependency-Based Construction of Semantic Space Models
Computational Linguistics
A structured vector space model for word meaning in context
EMNLP '08 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Holographic reduced representations
IEEE Transactions on Neural Networks
Using landing pages for sponsored search ad selection
Proceedings of the 19th international conference on World wide web
Syntactic and semantic factors in processing difficulty: an integrated measure
ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
Measuring distributional similarity in context
EMNLP '10 Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing
EMNLP '10 Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing
A structured vector space model for hidden attribute meaning in adjective-noun phrases
COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics
Structured composition of semantic vectors
IWCS '11 Proceedings of the Ninth International Conference on Computational Semantics
(Linear) maps of the impossible: capturing semantic anomalies in distributional space
DiSCo '11 Proceedings of the Workshop on Distributional Semantics and Compositionality
GEMS '11 Proceedings of the GEMS 2011 Workshop on GEometrical Models of Natural Language Semantics
Exploring supervised lda models for assigning attributes to adjective-noun phrases
EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Evaluating distributional models of semantics for syntactically invariant inference
EACL '12 Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics
| Hi-index | 0.00 |
In this paper we propose a novel statistical language model to capture long-range semantic dependencies. Specifically, we apply the concept of semantic composition to the problem of constructing predictive history representations for upcoming words. We also examine the influence of the underlying semantic space on the composition task by comparing spatial semantic representations against topic-based ones. The composition models yield reductions in perplexity when combined with a standard n-gram language model over the n-gram model alone. We also obtain perplexity reductions when integrating our models with a structured language model.