Automatic classification of web search results: product review vs. non-review documents

  • Authors:
  • Tun Thura Thet;Jin-Cheon Na;Christopher S. G. Khoo

  • Affiliations:
  • Wee Kim Wee School of Communication and Information, Nanyang Technological University, Singapore;Wee Kim Wee School of Communication and Information, Nanyang Technological University, Singapore;Wee Kim Wee School of Communication and Information, Nanyang Technological University, Singapore

  • Venue:
  • ICADL'07 Proceedings of the 10th international conference on Asian digital libraries: looking back 10 years and forging new frontiers
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

This study seeks to develop an automatic method to identify product review documents on the Web using the snippets (summary information that includes the URL, title, and summary text) returned by the Web search engine. The aim is to allow the user to extend topical search with genre-based filtering or categorization. Firstly we applied a common machine learning technique, SVM (Support Vector Machine), to investigate which features of the snippets are useful for classification. The best results were obtained using just the title and URL (domain and folder names) of the snippets as phrase terms (n-grams). Then we developed a heuristic approach that utilizes domain knowledge constructed semi-automatically, and found that it performs comparatively well, with only a small drop in accuracy rates. A hybrid approach which combines both the machine learning and heuristic approaches performs slightly better than the machine learning approach alone.