A critical examination of TDT's cost function

Authors:
R. Manmatha;Ao Feng;James Allan
Affiliations:
University of Massachusetts, Amherst, MA;University of Massachusetts, Amherst, MA;University of Massachusetts, Amherst, MA
Venue:
SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Year:
2002

Citing 3
Cited 10

Modeling score distributions for combining the outputs of search engines

Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
The score-distributional threshold optimization for adaptive binary classification tasks

Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
Topic detection and tracking evaluation overview

Topic detection and tracking

Evaluation of filtering current news search results

Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval
Automatic classification of Web queries using very large unlabeled query logs

ACM Transactions on Information Systems (TOIS)
Cross-document event clustering using knowledge mining from co-reference chains

Information Processing and Management: an International Journal - Special issue: AIRS2005: Information retrieval research in Asia
Repeatable evaluation of search services in dynamic environments

ACM Transactions on Information Systems (TOIS)
An adaptive threshold framework for event detection using HMM-based life profiles

ACM Transactions on Information Systems (TOIS)
Product query classification

Proceedings of the 18th ACM conference on Information and knowledge management
New event detection and topic tracking in Turkish

Journal of the American Society for Information Science and Technology
Cross document event clustering using knowledge mining from co-reference chains

AIRS'05 Proceedings of the Second Asia conference on Asia Information Retrieval Technology
Indices of novelty for emerging topic detection

Information Processing and Management: an International Journal
Query phrase suggestion from topically tagged session logs

FQAS'06 Proceedings of the 7th international conference on Flexible Query Answering Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

Topic Detection and Tracking (TDT) tasks are evaluated using a cost function. The standard TDT cost function assumes a constant probability of relevance P(rel) across all topics. In practice, P(rel) varies widely across topics. We argue using both theoretical and experimental evidence that the cost function should be modified to account for the varying P(rel).