Topic detection and tracking evaluation overview

Authors:
Jonathan G. Fiscus;George R. Doddington
Affiliations:
Information Access Division, Information Technology Laboratory, National Institute of Standards and Technology, Gaithersburg, MD;Information Access Division, Information Technology Laboratory, National Institute of Standards and Technology, Gaithersburg, MD
Venue:
Topic detection and tracking
Year:
2002

Citing 0
Cited 31

Improving realism of topic tracking evaluation

SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
A critical examination of TDT's cost function

SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Comparison of Normalization Techniques for Metasearch

ADVIS '02 Proceedings of the Second International Conference on Advances in Information Systems
Flexible intrinsic evaluation of hierarchical clustering for TDT

CIKM '03 Proceedings of the twelfth international conference on Information and knowledge management
Simple Semantics in Topic Detection and Tracking

Information Retrieval
A month to topic detection and tracking in Hindi

ACM Transactions on Asian Language Information Processing (TALIP)
Language-specific models in multilingual topic tracking

Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval
NLP and IR approaches to monolingual and multilingual link detection

COLING '02 Proceedings of the 19th international conference on Computational linguistics - Volume 1
Robustness of adaptive filtering methods in a cross-benchmark evaluation

Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Robust named entity extraction from large spoken archives

HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
Cross-document event clustering using knowledge mining from co-reference chains

Information Processing and Management: an International Journal - Special issue: AIRS2005: Information retrieval research in Asia
Use of place information for improved event tracking

Information Processing and Management: an International Journal - Special issue: AIRS2005: Information retrieval research in Asia
Utility-based information distillation over temporally sequenced documents

SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
Robust techniques for organizing and retrieving spoken documents

EURASIP Journal on Applied Signal Processing
A formal approach to score normalization for meta-search

HLT '02 Proceedings of the second international conference on Human Language Technology Research
Relevance models for topic detection and tracking

HLT '02 Proceedings of the second international conference on Human Language Technology Research
Generalizing from relevance feedback using named entity wildcards

Proceedings of the sixteenth ACM conference on Conference on information and knowledge management
An adaptive threshold framework for event detection using HMM-based life profiles

ACM Transactions on Information Systems (TOIS)
Feature selection for trainable multilingual broadcast news segmentation

HLT-NAACL-Short '04 Proceedings of HLT-NAACL 2004: Short Papers
New event detection and topic tracking in Turkish

Journal of the American Society for Information Science and Technology
Use of topicality and information measures to improve document representation for story link detection

ECIR'07 Proceedings of the 29th European conference on IR research
A framework for text processing and supporting access to collections of digitized historical newspapers

Proceedings of the 2007 conference on Human interface: Part II
Effect of overt pronoun resolution in topic tracking

LTC'09 Proceedings of the 4th conference on Human language technology: challenges for computer science and linguistics
Why did the prime minister resign?: generation of event explanations from large news repositories

MM '11 Proceedings of the 19th ACM international conference on Multimedia
Cross document event clustering using knowledge mining from co-reference chains

AIRS'05 Proceedings of the Second Asia conference on Asia Information Retrieval Technology
Large scale evaluations of multimedia information retrieval: the TRECVid experience

CIVR'05 Proceedings of the 4th international conference on Image and Video Retrieval
Evaluation of an interactive topic detection and tracking interface

Journal of Information Science
Detecting hot topics in chinese microblog streams based on frequent patterns mining

WISM'12 Proceedings of the 2012 international conference on Web Information Systems and Mining
Semantic Expansion of Tweet Contents for Enhanced Event Detection in Twitter

ASONAM '12 Proceedings of the 2012 International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2012)
Analyzing future communities in growing citation networks

Proceedings of the 2013 international workshop on Mining unstructured big data using natural language processing
Evidential location estimation for events detected in Twitter

Proceedings of the 7th Workshop on Geographic Information Retrieval

Quantified Score

Hi-index	0.01

Visualization

Abstract

The objective of the Topic Detection and Tracking (TDT) program is to develop technologies that search, organize and structure multilingual, news oriented textual materials from a variety of broadcast news media. This research program uses controlled laboratory simulations of hypothetical systems to test the efficacy of potential technologies, to gauge research progress, and to provide a forum for the exchange of research information. This chapter introduces TDT's evaluation methodology including: the Linguistic Data Consortium's TDT corpora, evaluation metrics used in TDT and the five TDT research tasks: Topic Tracking, Link Detection, Topic Detection, First Story Detection, and Story Segmentation.