A Topic-Specific Web Robot Model Based on Restless Bandits

  • Authors:
  • Tadhg O'Meara;Ahmed Patel

  • Affiliations:
  • -;-

  • Venue:
  • IEEE Internet Computing
  • Year:
  • 2001

Quantified Score

Hi-index 0.00

Visualization

Abstract

Constructing and maintaining topic-specific Web indexes is modeled by a restless-bandits generalization and resolved by a reinforcement-learning algorithm. The authors outline the potential role of topic-specific robots in distributed search engine design, and they model the complex problem of automatically constructing and maintaining topic-specific Web indexes. Experimental results establish the viability of a topic-specific Web robot design based on the restless bandit model. The results indicate that the proposed algorithm is a good foundation on which to build a complete solution