SpidersRUs: Creating specialized search engines in multiple languages

  • Authors:
  • Michael Chau;Jialun Qin;Yilu Zhou;Chunju Tseng;Hsinchun Chen

  • Affiliations:
  • School of Business, The University of Hong Kong, Pokfulam, Hong Kong;Department of Management, University of Massachusetts Lowell, Lowell, MA 01854, USA;Information Systems and Technology Management, George Washington University, Washington, DC 20052, USA;Department of Management Information Systems, The University of Arizona, Tucson, AZ 85721, USA;Department of Management Information Systems, The University of Arizona, Tucson, AZ 85721, USA

  • Venue:
  • Decision Support Systems
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

While small-scale search engines in specific domains and languages are increasingly used by Web users, most existing search engine development tools do not support the development of search engines in languages other than English, cannot be integrated with other applications, or rely on proprietary software. A tool that supports search engine creation in multiple languages is thus highly desired. To study the research issues involved, we review related literature and suggest the criteria for an ideal search tool. We present the design of a toolkit, called SpidersRUs, developed for multilingual search engine creation. The design and implementation of the tool, consisting of a Spider module, an Indexer module, an Index Structure, a Search module, and a Graphical User Interface module, are discussed in detail. A sample user session and a case study on using the tool to develop a medical search engine in Chinese are also presented. The technical issues involved and the lessons learned in the project are then discussed. This study demonstrates that the proposed architecture is feasible in developing search engines easily in different languages such as Chinese, Spanish, Japanese, and Arabic.