Clustering Massive Text Data Streams by Semantic Smoothing Model

Authors:
Yubao Liu;Jiarong Cai;Jian Yin;Ada Wai-Chee Fu
Affiliations:
Department of Computer Science of Sun Yat-Sen University, Guangzhou, 510275, China;Department of Computer Science of Sun Yat-Sen University, Guangzhou, 510275, China;Department of Computer Science of Sun Yat-Sen University, Guangzhou, 510275, China;Department of Computer Science and Engineering, the Chinese University of Hong Kong, Hong Kong,
Venue:
ADMA '07 Proceedings of the 3rd international conference on Advanced Data Mining and Applications
Year:
2007

Citing 7
Cited 0

A study of retrospective and on-line event detection

Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
A framework for diagnosing changes in evolving data streams

Proceedings of the 2003 ACM SIGMOD international conference on Management of data
Parameter free bursty events detection in text streams

VLDB '05 Proceedings of the 31st international conference on Very large data bases
2005 Special Issue: Efficient streaming text clustering

Neural Networks - 2005 Special issue: IJCNN 2005
Context-sensitive semantic smoothing for the language modeling approach to genomic IR

SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
Semantic Smoothing for Model-based Document Clustering

ICDM '06 Proceedings of the Sixth International Conference on Data Mining
A framework for projected clustering of high dimensional data streams

VLDB '04 Proceedings of the Thirtieth international conference on Very large data bases - Volume 30

Quantified Score

Hi-index	0.00

Visualization

Abstract

Clustering text data streams is an important issue in data mining community and has a number of applications such as news group filtering, text crawling, document organization and topic detection and tracing etc. However, most methods are similarity-based approaches and use the TF*IDF scheme to represent the semantics of text data and often lead to poor clustering quality. In this paper, we firstly give an improved semantic smoothing model for text data stream environment. Then we use the improved semantic model to improve the clustering quality and present an online clustering algorithm for clustering massive text data streams. In our algorithm, a new cluster statistics structure, cluster profile, is presented in which the semantics of text data streams are captured. We also present the experimental results illustrating the effectiveness of our technique.