A large-scale distributed framework for information retrieval in large dynamic search spaces

  • Authors:
  • Eugene Santos, Jr.;Eunice E. Santos;Hien Nguyen;Long Pan;John Korah

  • Affiliations:
  • Thayer School of Engineering, Dartmouth College, Hanover, USA 03755;Department of Computer Science, University of Texas at El Paso, El Paso, USA 79968-0518;Mathematical and Computer Sciences Department, University of Wisconsin, Whitewater, USA 53190;Department of Computer Science, Virginia Polytechnic Institute & State University, Blacksburg, USA 24060;Department of Computer Science, University of Texas at El Paso, El Paso, USA 79968-0518

  • Venue:
  • Applied Intelligence
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

One of the main problems facing human analysts dealing with large amounts of dynamic data is that important information may not be assessed in time to aid the decision making process. We present a novel distributed processing framework called Intelligent Foraging, Gathering and Matching (I-FGM) that addresses this problem by concentrating on resource allocation and adapting to computational needs in real-time. It serves as an umbrella framework in which the various tools and techniques available in information retrieval can be used effectively and efficiently. We implement a prototype of I-FGM and validate it through both empirical studies and theoretical performance analysis.