A Scalable Topic-Based Open Source Search Engine

  • Authors:
  • Wray Buntine;Jaakko Lofstrom;Jukka Perkio;Sami Perttu;Vladimir Poroshin;Tomi Silander;Henry Tirri;Antti Tuominen;Ville Tuulos

  • Affiliations:
  • Helsinki Institute for Information Technology, Finland;Helsinki Institute for Information Technology, Finland;Helsinki Institute for Information Technology, Finland;Helsinki Institute for Information Technology, Finland;Helsinki Institute for Information Technology, Finland;Helsinki Institute for Information Technology, Finland;Helsinki Institute for Information Technology, Finland;Helsinki Institute for Information Technology, Finland;Helsinki Institute for Information Technology, Finland

  • Venue:
  • WI '04 Proceedings of the 2004 IEEE/WIC/ACM International Conference on Web Intelligence
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Site-based or topic-specific search engines work with mixed success because of the general difficulty of the information retrieval task, and the lack of good link information to allow authorities to be identified. We are advocating an open source approach to the problem due to its scope and need for software components. We have adopted a topic-based search engine because it represents the next generation of capability. This paper outlines our scalable system for site-based or topic-specific search, and demonstrates the developing system on a small 250,000 document collection of EU and UN web pages.