Learning and inference in probabilistic classifier chains with beam search

  • Authors:
  • Abhishek Kumar;Shankar Vembu;Aditya Krishna Menon;Charles Elkan

  • Affiliations:
  • Department of Computer Science, UC San Diego;Donnelly Centre for Cellular and Biomolecular Research, University of Toronto, Canada;Department of Computer Science, UC San Diego;Department of Computer Science, UC San Diego

  • Venue:
  • ECML PKDD'12 Proceedings of the 2012 European conference on Machine Learning and Knowledge Discovery in Databases - Volume Part I
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Multilabel learning is an extension of binary classification that is both challenging and practically important. Recently, a method for multilabel learning called probabilistic classifier chains (PCCs) was proposed with numerous appealing properties, such as conceptual simplicity, flexibility, and theoretical justification. However, PCCs suffer from the computational issue of having inference that is exponential in the number of tags, and the practical issue of being sensitive to the suitable ordering of the tags while training. In this paper, we show how the classical technique of beam search may be used to solve both these problems. Specifically, we show how to use beam search to perform tractable test time inference, and how to integrate beam search with training to determine a suitable tag ordering. Experimental results on a range of multilabel datasets show that these proposed changes dramatically extend the practical viability of PCCs.