Trigger Grouping: A Scalable Approach to Large Scale Information Monitoring

  • Authors:
  • Wei Tang;Ling Liu;Calton Pu

  • Affiliations:
  • -;-;-

  • Venue:
  • NCA '03 Proceedings of the Second IEEE International Symposium on Network Computing and Applications
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

Information change monitoring services are becoming increasingly useful as more and more informationis published on the Web. A major research challengeis how to make the service scalable to serve millionsof monitoring requests. Such services usually use softtriggers to model users' monitoring requests. We havedeveloped an effective trigger grouping scheme to optimize the trigger processing. The main idea behind thisscheme is to reduce repeated computation by groupingmonitoring requests of similar structures together. Inthis paper, we evaluate our approach using both measurements on real systems and simulations. The studyshows significant performance gains using the triggergrouping approach. Moreover, the gains are criticallydependent on group size and group size distribution(e.g., Zipf). We also discuss the benefit, trade-off, andruntime characteristics of the proposed approach.