Towards progressive and load balancing distributed computation: a case study on skyline analysis

  • Authors:

  • Jin Huang;Feng Zhao;Jian Chen;Jian Pei;Jian Yin

  • Affiliations:

  • School of Information Science and Technology, Sun Yat-Sen University, Guangzhou, China;School of Software Engineering, South China University of Technology, Guangzhou, China;School of Software Engineering, South China University of Technology, Guangzhou, China;School of Computing Science, Simon Fraser University, British Columbia, Canada;School of Information Science and Technology, Sun Yat-Sen University, Guangzhou, China

  • Venue:
  • Journal of Computer Science and Technology
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Many latest high performance distributed computational environments come with high bandwidth in communication. Such high bandwidth distributed systems provide unprecedented opportunities for analyzing huge datasets, but simultaneously posts new technical challenges. For users, progressive query answering is important. For utility of systems, load balancing is critical. How we can achieve progressive and load balancing distributed computation is an interesting and promising research direction. As skyline analysis has been shown very useful in many multi-criteria decision making applications, in this paper, we study the problem of progressive and load balancing distributed skyline analysis. We propose a simple yet scalable approach which comes with several nice properties for progressive and load balancing query answering. We conduct extensive experiments which demonstrate the feasibility and effectiveness of the proposed method.