Hierarchical Classifier Design Using Mutual Information

  • Authors:
  • I. K. Sethi;G. P. R. Sarvarayudu

  • Affiliations:
  • Department of Electronics and Electrical Communication Engineering, Indian Institute of Technology, Kharagpur 721 302, India.;Jawaharlal Nehru Technological University, India/ Department of Electronics and Electrical Communication Engineering, Indian Institute of Technology, Kharagpur 721 302, India.

  • Venue:
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • Year:
  • 1982

Quantified Score

Hi-index 0.14

Visualization

Abstract

A nonparametric algorithm is presented for the hierarchical partitioning of the feature space. The algorithm is based on the concept of average mutual information, and is suitable for multifeature multicategory pattern recognition problems. The algorithm generates an efficient partitioning tree for specified probability of error by maximizing the amount of average mutual information gain at each partitioning step. A confidence bound expression is presented for the resulting classifier. Three examples, including one of handprinted numeral recognition, are presented to demonstrate the effectiveness of the algorithm.