Noisy-or classifier: Research Articles

  • Authors:
  • Jiří Vomlel

  • Affiliations:
  • Institute of Information Theory and Automation, Academy of Sciences of the Czech Republic, Prague, Czech Republic

  • Venue:
  • International Journal of Intelligent Systems - Uncertainty Processing
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

I discuss an application of a family of Bayesian network models—known as models of independence of causal influence (ICI)—to classification tasks with large numbers of attributes. An example of such a task is categorization of text documents, in which attributes are single words from the documents. The key that enabled application of the ICI models is their compact representation using a hidden variable. The issue of learning these classifiers by a computationally efficient implementation of the EM algorithm is addressed. Special attention is paid to the noisy-or model—probably the best-known example of an ICI model. The classification using the noisy-or model corresponds to a statistical method known as logistic discrimination. The correspondence is described. Tests of the noisy-or classifier on the Reuters data set show that, despite its simplicity, it has a competitive performance. © 2006 Wiley Periodicals, Inc. Int J Int Syst 21: 381–398, 2006.