Retriever: A Self-Training Agent for Intelligent Information Discovery

• Venue: ICIIS '99 Proceedings of the 1999 International Conference on Information Intelligence and Systems
• Year: 1999

With the exponential growth of Internet and the volume of information published over it, searching for information of interest has become a very difficult and time-consuming task. In this paper we present 'Retriever', an autonomous agent that executes user-queries and returns high quality results to the user. Retriever utilizes existing search engines to obtain the starting points for its subsequent autonomous exploration of the Web. Then it conducts a self-training process, in order to learn the query domain and increase its efficiency. When the query domain is learned, the agent expands the original query, reforms its search strategy and goes out looking for the documents to be presented to the user. It also incorporates relevance feedback in order to perform subsequent searches on the same query.