A Decentralized and Robust Approach to Estimating a Probabilistic Mixture Model for Structuring Distributed Data

Authors:
Ali El Attar;Antoine Pigeau;Marc Gelgon
Affiliations:
-;-;-
Venue:
WI-IAT '11 Proceedings of the 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Volume 01
Year:
2011

Citing 15
Cited 0

A fast algorithm for the minimum covariance determinant estimator

Technometrics
Toward the Next Generation of Recommender Systems: A Survey of the State-of-the-Art and Possible Extensions

IEEE Transactions on Knowledge and Data Engineering
Gossip-based aggregation in large dynamic networks

ACM Transactions on Computer Systems (TOCS)
Pattern Recognition and Machine Learning (Information Science and Statistics)

Pattern Recognition and Machine Learning (Information Science and Statistics)
Gossip-based peer sampling

ACM Transactions on Computer Systems (TOCS)
k-means++: the advantages of careful seeding

SODA '07 Proceedings of the eighteenth annual ACM-SIAM symposium on Discrete algorithms
Gossiping in distributed systems

ACM SIGOPS Operating Systems Review - Gossip-based computer networking
Fully distributed EM for very large datasets

Proceedings of the 25th international conference on Machine learning
Anomaly detection: A survey

ACM Computing Surveys (CSUR)
Parsimonious reduction of Gaussian mixture models with a variational-Bayes approach

Pattern Recognition
Knowledge Propagation in Collaborative Tagging for Image Retrieval

Journal of Signal Processing Systems
A distributed EM algorithm to estimate the parameters of a finite mixture of components

Knowledge and Information Systems
Privacy and confidentiality in context-based and epidemic forwarding

Computer Communications
Probabilistic latent semantic analysis

UAI'99 Proceedings of the Fifteenth conference on Uncertainty in artificial intelligence
Distributed EM Algorithm for Gaussian Mixtures in Sensor Networks

IEEE Transactions on Neural Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

Data sharing services on the web host huge amounts of resources supplied and accessed by millions of users around the world. While the classical approach is a central control over the data set, even if this data set is distributed, there is growing interesting in decentralized solutions, because of good properties (in particularity, privacy and scaling up). In this paper, we explore a machine learning side of this work direction. We propose a novel technique for decentralized estimation of probabilistic mixture models, which are among the most versatile generative models for understanding data sets. More precisely, we demonstrate how to estimate a global mixture model from a set of local models. Our approach accommodates dynamic topology and data sources and is statistically robust, i.e. resilient to the presence of unreliable local models. Such outlier models may arise from local data which are outliers, compared to the global trend, or poor mixture estimation. We report experiments on synthetic data and real geo-location data from Flickr.