Adaptive Web Search: Evolving a Program That Finds Information

  • Authors:
  • Michael Gordon;Weiguo (Patrick) Fan;Praveen Pathak

  • Affiliations:
  • University of Michigan;Virginia Tech;University of Florida

  • Venue:
  • IEEE Intelligent Systems
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Search engines contain programs that compare the words in a user's query to the words and phrases in Web pages. This comparisonemphasizes relatively rare terms, terms that occur frequently in a page, and terms in prominent positions (such as a page's title), amongother textual clues that suggest what the page is about. Although all search engines differ in the ways they determine which Web pages topresent to a user, each incorporates a method that its designers hope will be effective. Nonetheless, retrieval algorithms performinconsistently—some better in one circumstance, others in another--with no way to know in advance which will be most effective. Theauthors approach retrieval from a learning perspective. Rather than determining how to combine lexical clues beforehand, they infer howthis should be done on the basis of users' evaluations of previously viewed documents. Unlike conventional systems, this approachautomatically evolves new retrieval programs through genetic programming. It seems particularly effective for users whose need forinformation remains consistent over weeks or months.