Kernel-Based Hybrid Random Fields for Nonparametric Density Estimation

  • Authors:
  • Antonino Freno;Edmondo Trentin;Marco Gori

  • Affiliations:
  • Dipartimento di Ingegneria dell'Informazione, Università degli Studi di Siena (Siena, Italy). Email: {freno, trentin, marco}@dii.unisi.it;Dipartimento di Ingegneria dell'Informazione, Università degli Studi di Siena (Siena, Italy). Email: {freno, trentin, marco}@dii.unisi.it;Dipartimento di Ingegneria dell'Informazione, Università degli Studi di Siena (Siena, Italy). Email: {freno, trentin, marco}@dii.unisi.it

  • Venue:
  • Proceedings of the 2010 conference on ECAI 2010: 19th European Conference on Artificial Intelligence
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Hybrid random fields are a recently proposed graphical model for pseudo-likelihood estimation in discrete domains. In this paper, we develop a continuous version of the model for nonparametric density estimation. To this aim, Nadaraya-Watson kernel estimators are used to model the local conditional densities within hybrid random fields. First, we introduce a heuristic algorithm for tuning the kernel bandwidhts in the conditional density estimators. Second, we propose a novel method for initializing the structure learning algorithm originally employed for hybrid random fields, which was meant instead for discrete variables. In order to test the accuracy of the proposed technique, we use a number of synthetic pattern classification benchmarks, generated from random distributions featuring nonlinear correlations between the variables. As compared to state-of-the-art nonparametric and semiparametric learning techniques for probabilistic graphical models, kernel-based hybrid random fields regularly outperform each considered alternative in terms of recognition accuracy, while preserving the scalability properties (with respect to the number of variables) that originally motivated their introduction.