{\cal U}Boost: Boosting with the Universum

  • Authors:
  • Chunhua Shen;Peng Wang;Fumin Shen;Hanzi Wang

  • Affiliations:
  • The University of Adelaide, Adelaide;Beihang University, Beijing;Nanjing University of Science and Technology, Nanjing;Xiamen University, Xiamen

  • Venue:
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • Year:
  • 2012

Quantified Score

Hi-index 0.14

Visualization

Abstract

It has been shown that the Universum data, which do not belong to either class of the classification problem of interest, may contain useful prior domain knowledge for training a classifier [1], [2]. In this work, we design a novel boosting algorithm that takes advantage of the available Universum data, hence the name {\cal U}Boost. {\cal U}Boost is a boosting implementation of Vapnik's alternative capacity concept to the large margin approach. In addition to the standard regularization term, {\cal U}Boost also controls the learned model's capacity by maximizing the number of observed contradictions. Our experiments demonstrate that {\cal U}Boost can deliver improved classification accuracy over standard boosting algorithms that use labeled data alone.