Multi-dimensional classification with Bayesian networks

Authors:
C. Bielza;G. Li;P. Larraòaga
Affiliations:
Computational Intelligence Group, Departamento de Inteligencia Artificial, Universidad Politécnica de Madrid, Boadilla del Monte, 28660 Madrid, Spain;Rega Institute and University Hospitals, Katholieke Universiteit Leuven, B-3000 Leuven, Belgium;Computational Intelligence Group, Departamento de Inteligencia Artificial, Universidad Politécnica de Madrid, Boadilla del Monte, 28660 Madrid, Spain
Venue:
International Journal of Approximate Reasoning
Year:
2011

Citing 40
Cited 14

A probabilistic causal model for diagnostic problem solving, part one: integrating symbolic causal inference with numeric probabilistic inference

IEEE Transactions on Systems, Man and Cybernetics - Special issue on artificial intelligence
A Bayesian Method for the Induction of Probabilistic Networks from Data

Machine Learning
Finding MAPs for belief networks is NP-hard

Artificial Intelligence
Abductive reasoning in Bayesian belief networks using a genetic algorithm

Pattern Recognition Letters - Special issue on genetic algorithms
Wrappers for feature subset selection

Artificial Intelligence - Special issue on relevance
Bayesian Network Classifiers

Machine Learning - Special issue on learning with probabilistic representations
Approximating MAPs for belief networks is NP-hard and other theorems

Artificial Intelligence
Bucket elimination: a unifying framework for reasoning

Artificial Intelligence
BoosTexter: A Boosting-based Systemfor Text Categorization

Machine Learning - Special issue on information retrieval
A general scheme for automatic generation of search heuristics from specification dependencies

Artificial Intelligence - Special issue on heuristic search in artificial intelligence
A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimisation: NSGA-II

PPSN VI Proceedings of the 6th International Conference on Parallel Problem Solving from Nature
Probabilistic Model-Based Diagnosis

MICAI '00 Proceedings of the Mexican International Conference on Artificial Intelligence: Advances in Artificial Intelligence
Tractable Average-Case Analysis of Naive Bayesian Classifiers

ICML '99 Proceedings of the Sixteenth International Conference on Machine Learning
Pattern Classification (2nd Edition)

Pattern Classification (2nd Edition)
Large Margin Methods for Structured and Interdependent Output Variables

The Journal of Machine Learning Research
Learning as search optimization: approximate large margin methods for structured prediction

ICML '05 Proceedings of the 22nd international conference on Machine learning
Feature selection in Bayesian classifiers for the prognosis of survival of cirrhotic patients treated with TIPS

Journal of Biomedical Informatics - Special issue: Clinical machine learning
Multilabel Neural Networks with Applications to Functional Genomics and Text Categorization

IEEE Transactions on Knowledge and Data Engineering
ML-KNN: A lazy learning approach to multi-label learning

Pattern Recognition
Dynamic Conditional Random Fields: Factorized Probabilistic Models for Labeling and Segmenting Sequence Data

The Journal of Machine Learning Research
Predicting Structured Data (Neural Information Processing)

Predicting Structured Data (Neural Information Processing)
A discretization algorithm based on Class-Attribute Contingency Coefficient

Information Sciences: an International Journal
Evidence and scenario sensitivities in naive Bayesian classifiers

International Journal of Approximate Reasoning
Decision trees for hierarchical multi-label classification

Machine Learning
Multi-Objective Learning of Multi-Dimensional Bayesian Classifiers

HIS '08 Proceedings of the 2008 8th International Conference on Hybrid Intelligent Systems
Inference and Learning in Multi-dimensional Bayesian Network Classifiers

ECSQARU '07 Proceedings of the 9th European Conference on Symbolic and Quantitative Approaches to Reasoning with Uncertainty
Bayesian classifiers based on kernel density estimation: Flexible classifiers

International Journal of Approximate Reasoning
Multi-label Classification Using Ensembles of Pruned Sets

ICDM '08 Proceedings of the 2008 Eighth IEEE International Conference on Data Mining
AND/OR Branch-and-Bound search for combinatorial optimization in graphical models

Artificial Intelligence
Combining instance-based learning and logistic regression for multilabel classification

Machine Learning
Automated heart wall motion abnormality detection from ultrasound images using Bayesian networks

IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Model-based diagnosis using causal networks

IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 1
Efficient stochastic local search for MPE solving

IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence
Guest editorial: special issue on structured prediction

Machine Learning
Probabilistic Graphical Models: Principles and Techniques - Adaptive Computation and Machine Learning

Probabilistic Graphical Models: Principles and Techniques - Adaptive Computation and Machine Learning
Feature selection for Bayesian network classifiers using the MDL-FS score

International Journal of Approximate Reasoning
Random k-Labelsets for Multilabel Classification

IEEE Transactions on Knowledge and Data Engineering
Mini-bucket heuristics for improved search

UAI'99 Proceedings of the Fifteenth conference on Uncertainty in artificial intelligence
A scheme for approximating probabilistic inference

UAI'97 Proceedings of the Thirteenth conference on Uncertainty in artificial intelligence
Approximating discrete probability distributions with dependence trees

IEEE Transactions on Information Theory

Most probable explanations in Bayesian networks: Complexity and tractability

International Journal of Approximate Reasoning
Approaching Sentiment Analysis by using semi-supervised learning of multi-dimensional classifiers

Neurocomputing
Multi-label classification using conditional dependency networks

IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Two
Bayesian chain classifiers for multidimensional classification

IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Three
Learning tree structure of label dependency for multi-label learning

PAKDD'12 Proceedings of the 16th Pacific-Asia conference on Advances in Knowledge Discovery and Data Mining - Volume Part I
Markov blanket-based approach for learning multi-dimensional Bayesian network classifiers: An application to predict the European Quality of Life-5 Dimensions (EQ-5D) from the 39-item Parkinson's Disease Questionnaire (PDQ-39)

Journal of Biomedical Informatics
Supervised pre-processing approaches in multiple class variables classification for fish recruitment forecasting

Environmental Modelling & Software
Predicting human immunodeficiency virus inhibitors using multi-dimensional Bayesian network classifiers

Artificial Intelligence in Medicine
An efficient probabilistic framework for multi-dimensional classification

Proceedings of the 22nd ACM international conference on Conference on information & knowledge management
An ensemble of Bayesian networks for multilabel classification

IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Probabilistic multi-label classification with sparse feature learning

IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Efficient monte carlo methods for multi-dimensional learning with classifier chains

Pattern Recognition
Assisting in search heuristics selection through multidimensional supervised classification: A case study on software testing

Information Sciences: an International Journal
Domains of competence of the semi-naive Bayesian network classifiers

Information Sciences: an International Journal

Quantified Score

Hi-index	0.00

Visualization

Abstract

Multi-dimensional classification aims at finding a function that assigns a vector of class values to a given vector of features. In this paper, this problem is tackled by a general family of models, called multi-dimensional Bayesian network classifiers (MBCs). This probabilistic graphical model organizes class and feature variables as three different subgraphs: class subgraph, feature subgraph, and bridge (from class to features) subgraph. Under the standard 0-1 loss function, the most probable explanation (MPE) must be computed, for which we provide theoretical results in both general MBCs and in MBCs decomposable into maximal connected components. Moreover, when computing the MPE, the vector of class values is covered by following a special ordering (gray code). Under other loss functions defined in accordance with a decomposable structure, we derive theoretical results on how to minimize the expected loss. Besides these inference issues, the paper presents flexible algorithms for learning MBC structures from data based on filter, wrapper and hybrid approaches. The cardinality of the search space is also given. New performance evaluation metrics adapted from the single-class setting are introduced. Experimental results with three benchmark data sets are encouraging, and they outperform state-of-the-art algorithms for multi-label classification.