Some inconsistencies and misnomers in probabilistic information retrieval
SIGIR '91 Proceedings of the 14th annual international ACM SIGIR conference on Research and development in information retrieval
Probabilistic models in information retrieval
The Computer Journal - Special issue on information retrieval
Term dependence: truncating the Bahadur Lazarsfeld expansion
Information Processing and Management: an International Journal
Some simple effective approximations to the 2-Poisson model for probabilistic weighted retrieval
SIGIR '94 Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval
Automatic routing and retrieval using Smart: TREC-2
TREC-2 Proceedings of the second conference on Text retrieval conference
Statistical methods for speech recognition
Statistical methods for speech recognition
A language modeling approach to information retrieval
Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
A hidden Markov model information retrieval system
Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval
A general language model for information retrieval
Proceedings of the eighth international conference on Information and knowledge management
Improving the effectiveness of information retrieval with local context analysis
ACM Transactions on Information Systems (TOIS)
Document language models, query models, and risk minimization for information retrieval
Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
Two-stage language models for information retrieval
SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Biterm language models for document retrieval
SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Capturing term dependencies using a language model based on sentence trees
Proceedings of the eleventh international conference on Information and knowledge management
Naive (Bayes) at Forty: The Independence Assumption in Information Retrieval
ECML '98 Proceedings of the 10th European Conference on Machine Learning
Inference and Estimation of a Long-Range Trigram Model
Inference and Estimation of a Long-Range Trigram Model
Discovery of linguistic relations using lexical attraction
Discovery of linguistic relations using lexical attraction
A new statistical parser based on bigram lexical dependencies
ACL '96 Proceedings of the 34th annual meeting on Association for Computational Linguistics
Immediate-head parsing for language models
ACL '01 Proceedings of the 39th Annual Meeting on Association for Computational Linguistics
Unsupervised learning of dependency structure for language modeling
ACL '03 Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1
Introduction to the special issue on statistical language modeling
ACM Transactions on Asian Language Information Processing (TALIP)
Linear discriminant model for information retrieval
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Integrating word relationships into language models
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Question answering passage retrieval using dependency relations
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
A Markov random field model for term dependencies
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Set-based vector model: An efficient approach for correlation-based ranking
ACM Transactions on Information Systems (TOIS)
Query expansion using term relationships in language models for information retrieval
Proceedings of the 14th ACM international conference on Information and knowledge management
The role of knowledge in conceptual retrieval: a study in the domain of clinical medicine
SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
Reranking answers for definitional QA using language modeling
ACL-44 Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics
An information-theoretic approach to automatic evaluation of summaries
HLT-NAACL '06 Proceedings of the main conference on Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics
Adaptive document clustering based on query-based similarity
Information Processing and Management: an International Journal
An empirical study of query expansion and cluster-based retrieval in language modeling approach
Information Processing and Management: an International Journal - Special issue: AIRS2005: Information retrieval research in Asia
Introduction to special issue on reasoning in natural language information processing
ACM Transactions on Asian Language Information Processing (TALIP)
A retrospective study of a hybrid document-context based retrieval model
Information Processing and Management: an International Journal
Effective keyword-based selection of relational databases
Proceedings of the 2007 ACM SIGMOD international conference on Management of data
Parsimonious translation models for information retrieval
Information Processing and Management: an International Journal
Latent concept expansion using markov random fields
SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
A new approach for evaluating query expansion: query-document term mismatch
SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
Revisiting the dependence language model for information retrieval
SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
NaLIX: A generic natural language search environment for XML data
ACM Transactions on Database Systems (TODS)
Open-domain question: answering
Foundations and Trends in Information Retrieval
Natural language processing for information retrieval: the time is ripe (again)
Proceedings of the ACM first Ph.D. workshop in CIKM
Automatic feature selection in the markov random field model for information retrieval
Proceedings of the sixteenth ACM conference on Conference on information and knowledge management
Hierarchical learning strategy in semantic relation extraction
Information Processing and Management: an International Journal
A graph method for keyword-based selection of the top-K databases
Proceedings of the 2008 ACM SIGMOD international conference on Management of data
Deep classification in large-scale text hierarchies
Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
Exploiting proximity feature in bigram language model for information retrieval
Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
Utilizing phrase based semantic information for term dependency
Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
On event space and rank equivalence between probabilistic retrieval models
Information Retrieval
Toward automatic facet analysis and need negotiation: Lessons from mediated search
ACM Transactions on Information Systems (TOIS)
Adapting information retrieval to query contexts
Information Processing and Management: an International Journal
A novel retrieval approach reflecting variability of syntactic phrase representation
Journal of Intelligent Information Systems
A Novel Language Model Based on Cognition Attention Attenuation in Web Retrieval
WI-IAT '08 Proceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology - Volume 01
Empirical Software Engineering
Statistical Language Models for Information Retrieval A Critical Review
Foundations and Trends in Information Retrieval
Computer Speech and Language
A syntactic tree matching approach to finding similar questions in community-based qa services
Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
A proximity language model for information retrieval
Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
An improved markov random field model for supporting verbose queries
Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
Integrating phrase inseparability in phrase-based model
Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
Two-stage query segmentation for information retrieval
Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
BioNLP '09 Proceedings of the Workshop on Current Trends in Biomedical Natural Language Processing
An Effective Approach to Verbose Queries Using a Limited Dependencies Language Model
ICTIR '09 Proceedings of the 2nd International Conference on Theory of Information Retrieval: Advances in Information Retrieval Theory
A word clustering approach for language model-based sentence retrieval in question answering systems
Proceedings of the 18th ACM conference on Information and knowledge management
A Generative Theory of Relevance
Journal of the American Society for Information Science and Technology
Word or phrase?: learning which unit to stress for information retrieval
ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - Volume 2
Improving Text Rankers by Term Locality Contexts
AIRS '09 Proceedings of the 5th Asia Information Retrieval Symposium on Information Retrieval Technology
Dependency Language Modeling Using KNN and PLSI
MICAI '09 Proceedings of the 8th Mexican International Conference on Artificial Intelligence
Social Tagging for Personalized Web Search
AI*IA '09: Proceedings of the XIth International Conference of the Italian Association for Artificial Intelligence Reggio Emilia on Emergent Perspectives in Artificial Intelligence
Improving probabilistic information retrieval by modeling burstiness of words
Information Processing and Management: an International Journal
Optimizing two stage bigram language models for IR
Proceedings of the 19th international conference on World wide web
A multi-dependency language modeling approach to information retrieval
PAKDD'07 Proceedings of the 2007 international conference on Emerging technologies in knowledge discovery and data mining
An axiomatic approach to exploit term dependencies in language model
AIRS'08 Proceedings of the 4th Asia information retrieval conference on Information retrieval technology
ECIR'08 Proceedings of the IR research, 30th European conference on Advances in information retrieval
Viewing term proximity from a different perspective
ECIR'08 Proceedings of the IR research, 30th European conference on Advances in information retrieval
CLEF'08 Proceedings of the 9th Cross-language evaluation forum conference on Evaluating systems for multilingual and multimodal information access
Adapting boosting for information retrieval measures
Information Retrieval
Multi-style language model for web scale information retrieval
Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
Event-based hyperspace analogue to language for query expansion
ACLShort '10 Proceedings of the ACL 2010 Conference Short Papers
Ranking under temporal constraints
CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
Clickthrough-based translation models for web search: from word models to phrase models
CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
Using various term dependencies according to their utilities
CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
MRIM-LIG at ImageCLEF 2009: robotvision, image annotation and retrieval tasks
CLEF'09 Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments
Using Markov chains to exploit word relationships in information retrieval
Large Scale Semantic Access to Content (Text, Image, Video, and Sound)
Information retrieval techniques for templated queries
Large Scale Semantic Access to Content (Text, Image, Video, and Sound)
Modeling term proximity for probabilistic information retrieval models
Information Sciences: an International Journal
Simple unsupervised grammar induction from raw text with cascaded finite state models
HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
CRTER: using cross terms to enhance probabilistic information retrieval
Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval
Unsupervised query segmentation using clickthrough for information retrieval
Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval
Pure high-order word dependence mining via information geometry
ICTIR'11 Proceedings of the Third international conference on Advances in information retrieval theory
Markov graphic method for information retrieval
AICI'11 Proceedings of the Third international conference on Artificial intelligence and computational intelligence - Volume Part II
A New Language Model Combining Single and Compound Terms
WI-IAT '11 Proceedings of the 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Volume 01
A quasi-synchronous dependence model for information retrieval
Proceedings of the 20th ACM international conference on Information and knowledge management
Broadening vector space schemes for improving the quality of information retrieval
APWeb'05 Proceedings of the 7th Asia-Pacific web conference on Web Technologies Research and Development
Relation-Based document retrieval for biomedical literature databases
DASFAA'06 Proceedings of the 11th international conference on Database Systems for Advanced Applications
Using the X-IOTA system in mono- and bilingual experiments at CLEF 2005
CLEF'05 Proceedings of the 6th international conference on Cross-Language Evalution Forum: accessing Multilingual Information Repositories
An empirical study of query expansion and cluster-based retrieval in language modeling approach
AIRS'05 Proceedings of the Second Asia conference on Asia Information Retrieval Technology
Word sense language model for information retrieval
AIRS'06 Proceedings of the Third Asia conference on Information Retrieval Technology
CICLing'06 Proceedings of the 7th international conference on Computational Linguistics and Intelligent Text Processing
Constructing a generic natural language interface for an XML database
EDBT'06 Proceedings of the 10th international conference on Advances in Database Technology
Binary lexical relations for text representation in information retrieval
NLDB'05 Proceedings of the 10th international conference on Natural Language Processing and Information Systems
LSM: language sense model for information retrieval
WAIM '06 Proceedings of the 7th international conference on Advances in Web-Age Information Management
Towards a better understanding of language model information retrieval
FDIA'08 Proceedings of the 2nd BCS IRSG conference on Future Directions in Information Access
Personalized query expansion in the QIC system
Proceedings of the 12th ACM/IEEE-CS joint conference on Digital Libraries
Computational Intelligence
Natural language technology and query expansion: issues, state-of-the-art and perspectives
Journal of Intelligent Information Systems
Query difficulty estimation for image retrieval
Neurocomputing
Modeling higher-order term dependencies in information retrieval using query hypergraphs
SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
Translation techniques in cross-language information retrieval
ACM Computing Surveys (CSUR)
EMNLP-CoNLL '12 Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning
The bootstrapping based recognition of conceptual relationship for text retrieval
NLDB'07 Proceedings of the 12th international conference on Applications of Natural Language to Information Systems
Modeling term dependencies with quantum language models for IR
Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
Flat vs. hierarchical phrase-based translation models for cross-language information retrieval
Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
Mining pure high-order word associations via information geometry for information retrieval
ACM Transactions on Information Systems (TOIS)
A novel neighborhood based document smoothing model for information retrieval
Information Retrieval
On segmentation of eCommerce queries
Proceedings of the 22nd ACM international conference on Conference on information & knowledge management
Latent word context model for information retrieval
Information Retrieval
Semantic concept-enriched dependence model for medical information retrieval
Journal of Biomedical Informatics
| Hi-index | 0.00 |
This paper presents a new dependence language modeling approach to information retrieval. The approach extends the basic language modeling approach based on unigram by relaxing the independence assumption. We integrate the linkage of a query as a hidden variable, which expresses the term dependencies within the query as an acyclic, planar, undirected graph. We then assume that a query is generated from a document in two stages: the linkage is generated first, and then each term is generated in turn depending on other related terms according to the linkage. We also present a smoothing method for model parameter estimation and an approach to learning the linkage of a sentence in an unsupervised manner. The new approach is compared to the classical probabilistic retrieval model and the previously proposed language models with and without taking into account term dependencies. Results show that our model achieves substantial and significant improvements on TREC collections.