Linear feature-based models for information retrieval

Authors:
Donald Metzler;W. Bruce Croft
Affiliations:
University of Massachusetts, Amherst, USA;University of Massachusetts, Amherst, USA
Venue:
Information Retrieval
Year:
2007

Citing 28
Cited 41

Numerical recipes in C (2nd ed.): the art of scientific computing

Numerical recipes in C (2nd ed.): the art of scientific computing
Inferring probability of relevance using the method of logistic regression

SIGIR '94 Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval
Inducing Features of Random Fields

IEEE Transactions on Pattern Analysis and Machine Intelligence
A language modeling approach to information retrieval

Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
The anatomy of a large-scale hypertextual Web search engine

WWW7 Proceedings of the seventh international conference on World Wide Web 7
Document language models, query models, and risk minimization for information retrieval

Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
A study of smoothing methods for language models applied to Ad Hoc information retrieval

Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
A statistical model for scientific readability

Proceedings of the tenth international conference on Information and knowledge management
Modern Information Retrieval

Modern Information Retrieval
The Importance of Prior Probabilities for Entry Page Search

SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Predicting query performance

SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
A Tutorial on Support Vector Machines for Pattern Recognition

Data Mining and Knowledge Discovery
Combining Statistical Learning with a Knowledge-Based Approach - A Case Study in Intensive Care Monitoring

ICML '99 Proceedings of the Sixteenth International Conference on Machine Learning
Optimizing search engines using clickthrough data

Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining
Discriminative models for information retrieval

Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval
Hyperplane margin classifiers on the multinomial manifold

ICML '04 Proceedings of the twenty-first international conference on Machine learning
Active feedback in ad hoc information retrieval

Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Accurately interpreting clickthrough data as implicit feedback

Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Text classification with kernels on the multinomial manifold

Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Linear discriminant model for information retrieval

Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Relevance weighting for query independent evidence

Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
A Markov random field model for term dependencies

Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Document quality models for web ad hoc retrieval

Proceedings of the 14th ACM international conference on Information and knowledge management
Learning to rank using gradient descent

ICML '05 Proceedings of the 22nd international conference on Machine learning
A support vector method for multivariate performance measures

ICML '05 Proceedings of the 22nd international conference on Machine learning
Thumbs up?: sentiment classification using machine learning techniques

EMNLP '02 Proceedings of the ACL-02 conference on Empirical methods in natural language processing - Volume 10
High accuracy retrieval with multiple nested ranker

SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
Boosting web retrieval through query operations

ECIR'05 Proceedings of the 27th European conference on Advances in Information Retrieval Research

Latent concept expansion using markov random fields

SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
Natural language processing for information retrieval: the time is ripe (again)

Proceedings of the ACM first Ph.D. workshop in CIKM
Automatic feature selection in the markov random field model for information retrieval

Proceedings of the sixteenth ACM conference on Conference on information and knowledge management
Fast learning of document ranking functions with the committee perceptron

WSDM '08 Proceedings of the 2008 International Conference on Web Search and Data Mining
Integrating an educational 3D game in Moodle

Simulation and Gaming
Regression Rank: Learning to Meet the Opportunity of Descriptive Queries

ECIR '09 Proceedings of the 31th European Conference on IR Research on Advances in Information Retrieval
An improved markov random field model for supporting verbose queries

Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
Learning concept importance using a weighted dependence model

Proceedings of the third ACM international conference on Web search and data mining
The anatomy of an ad: structured indexing and retrieval for sponsored search

Proceedings of the 19th international conference on World wide web
Learning to efficiently rank

Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
Properties of optimally weighted data fusion in CBMIR

Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
Discriminative models of integrating document evidence and document-candidate associations for expert search

Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
Improved latent concept expansion using hierarchical markov random fields

CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
Using various term dependencies according to their utilities

CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
Quality-biased ranking of web documents

Proceedings of the fourth ACM international conference on Web search and data mining
Parameterized concept weighting in verbose queries

Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval
Tag recommendation for georeferenced photos

Proceedings of the 3rd ACM SIGSPATIAL International Workshop on Location-Based Social Networks
When close enough is good enough: approximate positional indexes for efficient ranked retrieval

Proceedings of the 20th ACM international conference on Information and knowledge management
Learning to associate relevant photos to georeferenced textual documents

Proceedings of the 19th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems
Effective query formulation with multiple information sources

Proceedings of the fifth ACM international conference on Web search and data mining
Predicting Query Performance by Query-Drift Estimation

ACM Transactions on Information Systems (TOIS)
A field relevance model for structured document retrieval

ECIR'12 Proceedings of the 34th European conference on Advances in Information Retrieval
Fusing concept detection and geo context for visual search

Proceedings of the 2nd ACM International Conference on Multimedia Retrieval
Modeling higher-order term dependencies in information retrieval using query hypergraphs

SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
A ranking framework for entity oriented search using Markov random fields

Proceedings of the 1st Joint International Workshop on Entity-Oriented and Semantic Search
Combining multi-level evidence for medical record retrieval

Proceedings of the 2012 international workshop on Smart health and wellbeing
Learning to rank for robust question answering

Proceedings of the 21st ACM international conference on Information and knowledge management
Quality models for microblog retrieval

Proceedings of the 21st ACM international conference on Information and knowledge management
Can social features help learning to rank youtube videos?

WISE'12 Proceedings of the 13th international conference on Web Information Systems Engineering
Learning conditional preference network from noisy samples using hypothesis testing

Knowledge-Based Systems
Learning to rank for spatiotemporal search

Proceedings of the sixth ACM international conference on Web search and data mining
Two-Stage learning to rank for information retrieval

ECIR'13 Proceedings of the 35th European conference on Advances in Information Retrieval
Modeling term dependencies with quantum language models for IR

Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
Direct optimization of ranking measures for learning to rank models

Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining
Feeding the second screen: semantic linking based on subtitles

Proceedings of the 10th Conference on Open Research Areas in Information Retrieval
Incorporating social anchors for ad hoc retrieval

Proceedings of the 10th Conference on Open Research Areas in Information Retrieval
Methods for exploring and mining tables on Wikipedia

Proceedings of the ACM SIGKDD Workshop on Interactive Data Exploration and Analytics
Map search via a factor graph model

Proceedings of the 22nd ACM international conference on Conference on information & knowledge management
Improving passage ranking with user behavior information

Proceedings of the 22nd ACM international conference on Conference on information & knowledge management
Quality biased thread retrieval using the voting model

Proceedings of the 18th Australasian Document Computing Symposium
Tune and mix: learning to rank using ensembles of calibrated multi-class classifiers

Machine Learning

Quantified Score

Hi-index	0.00

Visualization

Abstract

There have been a number of linear, feature-based models proposed by the information retrieval community recently. Although each model is presented differently, they all share a common underlying framework. In this paper, we explore and discuss the theoretical issues of this framework, including a novel look at the parameter space. We then detail supervised training algorithms that directly maximize the evaluation metric under consideration, such as mean average precision. We present results that show training models in this way can lead to significantly better test set performance compared to other training methods that do not directly maximize the metric. Finally, we show that linear feature-based models can consistently and significantly outperform current state of the art retrieval models with the correct choice of features.