LTC: A latent tree approach to classification

  • Authors:
  • Yi Wang;Nevin L. Zhang;Tao Chen;Leonard K. M. Poon

  • Affiliations:
  • Department of Computer Science, National University of Singapore, Singapore 117417, Singapore;Department of Computer Science & Engineering, The Hong Kong University of Science & Technology, Clear Water Bay, Kowloon, Hong Kong;EMC Labs China, Beijing, China;Department of Computer Science & Engineering, The Hong Kong University of Science & Technology, Clear Water Bay, Kowloon, Hong Kong

  • Venue:
  • International Journal of Approximate Reasoning
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Latent tree models were proposed as a class of models for unsupervised learning, and have been applied to various problems such as clustering and density estimation. In this paper, we study the usefulness of latent tree models in another paradigm, namely supervised learning. We propose a novel generative classifier called latent tree classifier (LTC). An LTC represents each class-conditional distribution of attributes using a latent tree model, and uses Bayes rule to make prediction. Latent tree models can capture complex relationship among attributes. Therefore, LTC is able to approximate the true distribution behind data well and thus achieves good classification accuracy. We present an algorithm for learning LTC and empirically evaluate it on an extensive collection of UCI data. The results show that LTC compares favorably to the state-of-the-art in terms of classification accuracy. We also demonstrate that LTC can reveal underlying concepts and discover interesting subgroups within each class.