An Autonomous Agent Approach to Query Optimization in Stream Grids

  • Authors:
  • Saikat Mukherjee;Srinath Srinivasa;Krithi Ramamritham

  • Affiliations:
  • International Institute of Information Technology, India;International Institute of Information Technology, India;Indian Institute of Technology, India

  • Venue:
  • International Journal of Organizational and Collective Intelligence
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Stream grids are wide-area grid computing environments that are fed by a set of stream data sources, and Queries arrive at the grid from users and applications external to the system. The kind of queries considered in this work is long-running continuous LRC queries, which are neither short-lived nor infinitely long lived. The queries are "open" from the grid perspective as the grid cannot control or predict the arrival of a query with time, location, required data and query revocations. Query optimization in such an environment has two major challenges, i.e., optimizing in a multi-query environment and continuous optimization, due to new query arrivals and revocations. As generating a globally optimal query plan is an intractable problem, this work explores the idea of emergent optimization where globally optimal query plans emerge as a result of local autonomous decisions taken by the grid nodes. Drawing concepts from evolutionary game theory, grid nodes are modeled as autonomous agents that seek to maximize a self-interest function using one of a set of different strategies. Grid nodes change strategies in response to variations in query arrival and revocation patterns, which is also autonomously decided by each grid node.