An application of document filtering in an operational system

Authors:
Paul Lehner;Charles Worrell;Chrissy Vu;Janet Mittel;Stephen Snyder;Eric Schulte;Warren Greiff
Affiliations:
The MITRE Corporation, 7515 Colshire Dr., M/S N250, McLean, VA 22102, USA;The MITRE Corporation, 7515 Colshire Dr., M/S N250, McLean, VA 22102, USA;The MITRE Corporation, 7515 Colshire Dr., M/S N250, McLean, VA 22102, USA;The MITRE Corporation, 7515 Colshire Dr., M/S N250, McLean, VA 22102, USA;The MITRE Corporation, 7515 Colshire Dr., M/S N250, McLean, VA 22102, USA;The MITRE Corporation, 7515 Colshire Dr., M/S N250, McLean, VA 22102, USA;The MITRE Corporation, 7515 Colshire Dr., M/S N250, McLean, VA 22102, USA
Venue:
Information Processing and Management: an International Journal
Year:
2010

Citing 3
Cited 0

Machine learning in automated text categorization

ACM Computing Surveys (CSUR)
Not So Naive Bayes: Aggregating One-Dependence Estimators

Machine Learning
TREC: Experiment and Evaluation in Information Retrieval (Digital Libraries and Electronic Publishing)

TREC: Experiment and Evaluation in Information Retrieval (Digital Libraries and Electronic Publishing)

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes an applied document filtering system embedded in an operational watch center that monitors disease outbreaks worldwide. At the initial time of this writing, the system effectively supported monitoring of 23 geographic regions by filtering documents in several thousand daily news sources in 11 different languages. This paper describes the filtering algorithm, statistical procedures for estimating Precision and Recall in an operational environment, summarizes operational performance data and suggests lessons learned for other applications of document filtering technology. Overall, these results are interpreted as supporting the general utility of document filtering and information retrieval technology and offers recommendations for future applications of this technology.