Distributed Density Estimation Using Non-parametric Statistics

Authors:
Yusuo Hu;Hua Chen;Jian-guang Lou;Jiang Li
Affiliations:
Microsoft Research Asia, China;Tsinghua University;Microsoft Research Asia, China;Microsoft Research Asia, China
Venue:
ICDCS '07 Proceedings of the 27th International Conference on Distributed Computing Systems
Year:
2007

Citing 0
Cited 4

Multi-dimensional data density estimation in P2P networks

Distributed and Parallel Databases
RETRACTED: Impacts of sensor node distributions on coverage in sensor networks

Journal of Parallel and Distributed Computing
Personalized query evaluation in ring-based P2P networks

Information Sciences: an International Journal
A gossip-based approach for Internet-scale cardinality estimation of XPath queries over distributed semistructured data

The VLDB Journal — The International Journal on Very Large Data Bases

Quantified Score

Hi-index	0.00

Visualization

Abstract

Learning the underlying model from distributed data is often useful for many distributed systems. In this paper, we study the problem of learning a non-parametric model from distributed observations. We propose a gossip-based distributed kernel density estimation algorithm and analyze the convergence and consistency of the estimation process. Furthermore, we extend our algorithm to distributed systems under communication and storage constraints by introducing a fast and efficient data reduction algorithm. Experiments show that our algorithm can estimate underlying density distribution accurately and robustly with only small communication and storage overhead.