Distributed XML Stream Filtering System with High Scalability

  • Authors:
  • Hiroyuki Uchiyama;Makoto Onizuka;Takashi Honishi

  • Affiliations:
  • NTT Corporation;NTT Corporation;NTT Corporation

  • Venue:
  • ICDE '05 Proceedings of the 21st International Conference on Data Engineering
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a distributed XML stream filtering system that uses a large number of subscribersý profiles, written in XPath expressions, to filter XML streams and then publish the filtered data in real-time. To realize the proposed system, we define XPath expression features on XML data and utilize them to forecast the serversý loads. Our method is realized by combining methods to share the total transfer loads of each filtering server and to equalize the sum of overlap size between filtering servers. Experiments show that the rate at which the publishing time increases with the number of XPath expressions is three times smaller in the proposed system than in the round-robin method. Furthermore, the overhead of the proposed method is quite low.