Text Database Discovery on the Web: Neural Net Based Approach

  • Authors:
  • Yong S. Choi;Suk I. Yoo

  • Affiliations:
  • Department of Computer Science Education, Hanyang University, Hangdang-Dong, Seongdong-ku, Seoul 133-791, Korea. cys@email.hanyang.ac.kr;Department of Computer Science, Seoul National University, Shilim-dong, Kwanak-ku, Seoul 151-742, Korea. siyoo@hera.snu.ac.kr

  • Venue:
  • Journal of Intelligent Information Systems
  • Year:
  • 2001

Quantified Score

Hi-index 0.00

Visualization

Abstract

As large numbers of text databases have become available on the Web, many efforts have been made to solve the text database discovery problem: finding which text databases (out of many candidates) are most likely to provide relevant documents to a given query. In this paper, we propose a neural net based approach to this problem. First, we present a neural net agent that learns about underlying text databases from the user's relevance feedback. For a given query, the neural net agent, which is sufficiently trained on the basis of the backpropagation learning mechanism, discovers the text databases associated with the relevant documents and retrieves those documents effectively. In order to scale our approach with the large number of text databases, we also propose the hierarchical organization of neural net agents which reduces the total training cost at the acceptable level. Finally, we evaluate the performance of our approach by comparing it to those of the conventional well-known statistical approaches.