A study of retrospective and on-line event detection
Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
On-line new event detection and tracking
Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
The use of MMR, diversity-based reranking for reordering documents and producing summaries
Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
An Algorithm that Learns What‘s in a Name
Machine Learning - Special issue on natural language learning
First story detection in TDT is hard
Proceedings of the ninth international conference on Information and knowledge management
Novelty and redundancy detection in adaptive filtering
SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Topic-conditioned novelty detection
Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining
Beyond independent relevance: methods and evaluation metrics for subtopic retrieval
Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Retrieval and novelty detection at the sentence level
Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
A System for new event detection
Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Syntactic features in question answering
Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Evaluating question-answering techniques in Chinese
HLT '01 Proceedings of the first international conference on Human language technology research
First story detection using a composite document representation
HLT '01 Proceedings of the first international conference on Human language technology research
Improving novelty detection for general topics using sentence level information patterns
CIKM '06 Proceedings of the 15th ACM international conference on Information and knowledge management
Resource-adaptive real-time new event detection
Proceedings of the 2007 ACM SIGMOD international conference on Management of data
'Show me more': Incremental length summarisation using novelty detection
Information Processing and Management: an International Journal
An information-pattern-based approach to novelty detection
Information Processing and Management: an International Journal
Measuring novelty and redundancy with multiple modalities in cross-lingual broadcast news
Computer Vision and Image Understanding
Novelty as a form of contextual re-ranking: efficient KLD models and mixture models
Proceedings of the second international symposium on Information interaction in context
Type-Based Query Expansion for Sentence Retrieval
ICCS '07 Proceedings of the 7th international conference on Computational Science, Part I: ICCS 2007
Real-time new event detection for video streams
Proceedings of the 17th ACM conference on Information and knowledge management
Combining named entities and tags for novel sentence detection
Proceedings of the WSDM '09 Workshop on Exploiting Semantic Annotations in Information Retrieval
Exploration of term relationship for Bayesian network based sentence retrieval
Pattern Recognition Letters
Exploration of term dependence in sentence retrieval
ACL '07 Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions
EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 3 - Volume 3
Highly frequent terms and sentence retrieval
SPIRE'07 Proceedings of the 14th international conference on String processing and information retrieval
Improving sentence retrieval with an importance prior
Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
Multilingual novelty detection
Expert Systems with Applications: An International Journal
Efficient set-correlation operator inside databases
CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
An intelligent system for sentence retrieval and novelty mining
International Journal of Knowledge Engineering and Data Mining
Multilingual sentence categorization and novelty mining
Information Processing and Management: an International Journal
Named entity patterns across news domains
FDIA'07 Proceedings of the 1st BCS IRSG conference on Future Directions in Information Access
Sentence length bias in TREC novelty track judgements
Proceedings of the Seventeenth Australasian Document Computing Symposium
Hi-index | 0.01 |
The detection of new information in a document stream is an important component of many potential applications. In this paper, a new novelty detection approach based on the identification of sentence level patterns is proposed. Given a user's information need, some patterns in sentences such as combinations of query words, named entities and phrases, may contain more important and relevant information than single words. Therefore, the proposed novelty detection approach focuses on the identification of previously unseen query-related patterns in sentences. Specifically, a query is preprocessed and represented with patterns that include both query words and required answer types. These patterns are used to retrieve sentences, which are then determined to be novel if it is likely that a new answer is present. An analysis of patterns in sentences was performed with data from the TREC 2002 novelty track and experiments on novelty detection were carried out on data from the TREC 2003 and 2004 novelty tracks. The experimental results show that the proposed pattern-based approach significantly outperforms all three baselines in terms of precision at top ranks.