The empirical impact of the nature of novelty detection

Authors:
Le Zhao;Min Zhang;Shaoping Ma
Affiliations:
State Key Lab of Intelligent Tech. and Sys., Tsinghua University, Beijing, China;State Key Lab of Intelligent Tech. and Sys., Tsinghua University, Beijing, China;State Key Lab of Intelligent Tech. and Sys., Tsinghua University, Beijing, China
Venue:
AIRS'05 Proceedings of the Second Asia conference on Asia Information Retrieval Technology
Year:
2005

Citing 2
Cited 0

Term-weighting approaches in automatic text retrieval

Information Processing and Management: an International Journal
Novelty and redundancy detection in adaptive filtering

SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval

Quantified Score

Hi-index	0.00

Visualization

Abstract

Novelty detection systems aim at reducing redundant documents or sentences from a list of documents chronologically ordered. In the task, sentences appearing later in the list with no new meanings are eliminated. In an accompanying paper, the nature of novelty detection was revealed – Novelty as a combination of the PO (partial overlap) and CO (complete overlap) relations, which can be treated as two classification tasks; theoretical impacts were given. This paper provides what the nature of the task mean empirically. One new method – selected pool – implementing the nature of the task gained improvements on TREC Novelty datasets. New evaluation criteria are given, which are natural from the viewpoint of the nature of novelty detection.