Learning Bayesian networks from data: an information-theory based approach

Authors:
Jie Cheng;Russell Greiner;Jonathan Kelly;David Bell;Weiru Liu
Affiliations:
Univ. of Alberta, Edmonton, Canada;Univ. of Alberta, Edmonton, Canada;Univ. of Alberta, Edmonton, Canada;Univ. of Ulster, UK;Univ. of Ulster, UK
Venue:
Artificial Intelligence
Year:
2002

Citing 18
Cited 127

Probabilistic reasoning in intelligent systems: networks of plausible inference

Probabilistic reasoning in intelligent systems: networks of plausible inference
A Bayesian Method for the Induction of Probabilistic Networks from Data

Machine Learning
An algorithm for deciding if a set of observed independencies has a causal explanation

UAI '92 Proceedings of the eighth conference on Uncertainty in Artificial Intelligence
Learning Bayesian Networks: The Combination of Knowledge and Statistical Data

Machine Learning
Learning belief networks from data: an information theory based approach

CIKM '97 Proceedings of the sixth international conference on Information and knowledge management
Bayesian Network Classifiers

Machine Learning - Special issue on learning with probabilistic representations
Efficient reasoning

ACM Computing Surveys (CSUR)
A Guide to the Literature on Learning Probabilistic Networks from Data

IEEE Transactions on Knowledge and Data Engineering
Automated Construction of Sparse Bayesian Networks from Unstructured Probabilistic Models and Domain Information

UAI '89 Proceedings of the Fifth Annual Conference on Uncertainty in Artificial Intelligence
Equivalence and synthesis of causal models

UAI '90 Proceedings of the Sixth Annual Conference on Uncertainty in Artificial Intelligence
an entropy-driven system for construction of probabilistic expert systems from databases

UAI '90 Proceedings of the Sixth Annual Conference on Uncertainty in Artificial Intelligence
Comparing Bayesian network classifiers

UAI'99 Proceedings of the Fifteenth conference on Uncertainty in artificial intelligence
A hybrid anytime algorithm for the construction of causal models from sparse data

UAI'99 Proceedings of the Fifteenth conference on Uncertainty in artificial intelligence
The Bayesian structural EM algorithm

UAI'98 Proceedings of the Fourteenth conference on Uncertainty in artificial intelligence
Strong completeness and faithfulness in Bayesian networks

UAI'95 Proceedings of the Eleventh conference on Uncertainty in artificial intelligence
Learning Bayesian nets that perform well

UAI'97 Proceedings of the Thirteenth conference on Uncertainty in artificial intelligence
An algorithm for finding minimum d-separating sets in belief networks

UAI'96 Proceedings of the Twelfth international conference on Uncertainty in artificial intelligence
Learning equivalence classes of Bayesian network structures

UAI'96 Proceedings of the Twelfth international conference on Uncertainty in artificial intelligence

KDD Cup 2001 report

ACM SIGKDD Explorations Newsletter
Structural extension to logistic regression: discriminative parameter learning of belief net classifiers

Eighteenth national conference on Artificial intelligence
Learning Bayesian Networks from Incomplete Data Based on EMI Method

ICDM '03 Proceedings of the Third IEEE International Conference on Data Mining
Identifying Markov Blankets with Decision Tree Induction

ICDM '03 Proceedings of the Third IEEE International Conference on Data Mining
Time and sample efficient discovery of Markov blankets and direct causal relations

Proceedings of the ninth ACM SIGKDD international conference on Knowledge discovery and data mining
Semi-supervised learning for facial expression recognition

MIR '03 Proceedings of the 5th ACM SIGMM international workshop on Multimedia information retrieval
Semisupervised Learning of Classifiers: Theory, Algorithms, and Their Application to Human-Computer Interaction

IEEE Transactions on Pattern Analysis and Machine Intelligence
Data mining of Bayesian networks using cooperative coevolution

Decision Support Systems
Structural Extension to Logistic Regression: Discriminative Parameter Learning of Belief Net Classifiers

Machine Learning
Learning Bayesian Network Classifiers: Searching in a Space of Partially Directed Acyclic Graphs

Machine Learning
Inference of structures of models of probabilistic dependences from statistical data

Cybernetics and Systems Analysis
Full Bayesian network classifiers

ICML '06 Proceedings of the 23rd international conference on Machine learning
On the incompatibility of faithfulness and monotone DAG faithfulness

Artificial Intelligence
The max-min hill-climbing Bayesian network structure learning algorithm

Machine Learning
Learning Factor Graphs in Polynomial Time and Sample Complexity

The Journal of Machine Learning Research
A Scoring Function for Learning Bayesian Networks based on Mutual Information and Conditional Independence Tests

The Journal of Machine Learning Research
Bayesian network learning algorithms using structural restrictions

International Journal of Approximate Reasoning
On-line alert systems for production plants: A conflict based approach

International Journal of Approximate Reasoning
A kernel-based causal learning algorithm

Proceedings of the 24th international conference on Machine learning
Large-scale regulatory network analysis from microarray data: modified Bayesian network learning and association rule mining

Decision Support Systems
A hybrid Bayesian network learning method for constructing gene networks

Computational Biology and Chemistry
Information-theoretic inference of large transcriptional regulatory networks

EURASIP Journal on Bioinformatics and Systems Biology
Prognostic Bayesian networks

Journal of Biomedical Informatics
Machine learning: a review of classification and combining techniques

Artificial Intelligence Review
A Bayesian support tool for morphological design

Advanced Engineering Informatics
Appraisal of companies with Bayesian networks

International Journal of Business Intelligence and Data Mining
Learning Bayesian networks from incomplete databases using a novel evolutionary algorithm

Decision Support Systems
An improved Bayesian network structure learning algorithm and its application in an intelligent B2C portal

Web Intelligence and Agent Systems
A Recursive Method for Structural Learning of Directed Acyclic Graphs

The Journal of Machine Learning Research
BayesRule: A Markov-Blanket based procedure for extracting a set of probabilistic rules from Bayesian classifiers

International Journal of Hybrid Intelligent Systems - HIS 2007
Learning Bayesian Networks Based on a Mutual Information Scoring Function and EMI Method

ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Part II--Advances in Neural Networks
The Max-Relevance and Min-Redundancy Greedy Bayesian Network Learning Algorithm

IWINAC '07 Proceedings of the 2nd international work-conference on The Interplay Between Natural and Artificial Computation, Part I: Bio-inspired Modeling of Cognitive Tasks
Nasopharyngeal Carcinoma Data Analysis with a Novel Bayesian Network Skeleton Learning Algorithm

AIME '07 Proceedings of the 11th conference on Artificial Intelligence in Medicine
A Novel Greedy Bayesian Network Structure Learning Algorithm for Limited Data

ADMA '07 Proceedings of the 3rd international conference on Advanced Data Mining and Applications
Bayesian Network Structure Ensemble Learning

ADMA '07 Proceedings of the 3rd international conference on Advanced Data Mining and Applications
Structure Learning of Probabilistic Relational Models from Incomplete Relational Data

ECML '07 Proceedings of the 18th European conference on Machine Learning
Learning and Inferences of the Bayesian Network with Maximum Likelihood Parameters

ADMA '08 Proceedings of the 4th international conference on Advanced Data Mining and Applications
A Bayesian Student Model without Hidden Nodes and its Comparison with Item Response Theory

International Journal of Artificial Intelligence in Education
Augmenting learning function to Bayesian network inferences with maximum likelihood parameters

Expert Systems with Applications: An International Journal
Learning-Function-Augmented Inferences of Causalities Implied in Health Data

Advanced Web and NetworkTechnologies, and Applications
Large engineering project risk management using a Bayesian belief network

Expert Systems with Applications: An International Journal
Discovering semantic associations among Web services based on the qualitative probabilistic network

Expert Systems with Applications: An International Journal
Representing and Inferring Causalities among Classes of Multidimensional Data

APWeb/WAIM '09 Proceedings of the Joint International Conferences on Advances in Data and Web Management
Using Bayesian networks with rule extraction to infer the risk of weed infestation in a corn-crop

Engineering Applications of Artificial Intelligence
Supervised Machine Learning: A Review of Classification Techniques

Proceedings of the 2007 conference on Emerging Artificial Intelligence Applications in Computer Engineering: Real Word AI Systems with Applications in eHealth, HCI, Information Retrieval and Pervasive Technologies
Structure identification of Bayesian classifiers based on GMDH

Knowledge-Based Systems
On the classification performance of TAN and general Bayesian networks

Knowledge-Based Systems
A comparison of novel and state-of-the-art polynomial Bayesian network learning algorithms

AAAI'05 Proceedings of the 20th national conference on Artificial intelligence - Volume 2
Generalized additive Bayesian network classifiers

IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
A data driven ensemble classifier for credit scoring analysis

Expert Systems with Applications: An International Journal
Learning Bayesian network equivalence classes with Ant Colony optimization

Journal of Artificial Intelligence Research
On the incompatibility of faithfulness and monotone DAG faithfulness

Artificial Intelligence
Remote sensing data change detection based on the CI test of Bayesian networks

Computers & Geosciences
Mind change optimal learning of Bayes net structure from dependency and independency data

Information and Computation
Histogram distance-based Bayesian Network structure learning: A supervised classification specific approach

Decision Support Systems
Impact of censoring on learning Bayesian networks in survival modelling

Artificial Intelligence in Medicine
A conditional independence algorithm for learning undirected graphical models

Journal of Computer and System Sciences
Exploiting association and correlation rules parameters for learning Bayesian networks

Intelligent Data Analysis
An Expert System Based Approach to Modeling and Selecting Requirement Engineering Techniques

WISM '09 Proceedings of the International Conference on Web Information Systems and Mining
BBN-based privacy management sytem for facebook

ISI'09 Proceedings of the 2009 IEEE international conference on Intelligence and security informatics
Improved Bayesian Network inference using relaxed gene ordering

International Journal of Data Mining and Bioinformatics
A self-learning expert system for diagnosis in traditional Chinese medicine

Expert Systems with Applications: An International Journal
Mutual information preconditioning improves structure learning of Bayesian networks from medical databases

IEEE Transactions on Information Technology in Biomedicine - Special section on body sensor networks
Bayesian network modeling for evolutionary genetic structures

Computers & Mathematics with Applications
Local Causal and Markov Blanket Induction for Causal Discovery and Feature Selection for Classification Part I: Algorithms and Empirical Evaluation

The Journal of Machine Learning Research
Learning Bayesian networks with combination of MRMR criterion and EMI method

PAKDD'07 Proceedings of the 11th Pacific-Asia conference on Advances in knowledge discovery and data mining
Learning Bayesian networks using evolutionary algorithm and a variant of MDL score

KES'07/WIRN'07 Proceedings of the 11th international conference, KES 2007 and XVII Italian workshop on neural networks conference on Knowledge-based intelligent information and engineering systems: Part III
A hybrid approach for learning Markov equivalence classes of Bayesian network

KSEM'07 Proceedings of the 2nd international conference on Knowledge science, engineering and management
Algorithm for graphical Bayesian modeling based on multiple regressions

MICAI'07 Proceedings of the artificial intelligence 6th Mexican international conference on Advances in artificial intelligence
An improved greedy Bayesian network learning algorithm on limited data

ICANN'07 Proceedings of the 17th international conference on Artificial neural networks
Texture classification of aerial image based on Bayesian networks with hidden nodes

ISICA'07 Proceedings of the 2nd international conference on Advances in computation and intelligence
Local learning algorithm for markov blanket discovery

AI'07 Proceedings of the 20th Australian joint conference on Advances in artificial intelligence
A novel ordering-based Greedy Bayesian network learning algorithm on limited data

AI'07 Proceedings of the 20th Australian joint conference on Advances in artificial intelligence
A decomposition algorithm for learning Bayesian network structures from data

PAKDD'08 Proceedings of the 12th Pacific-Asia conference on Advances in knowledge discovery and data mining
Tradeoff analysis of different Markov blanket local learning approaches

PAKDD'08 Proceedings of the 12th Pacific-Asia conference on Advances in knowledge discovery and data mining
Fast Markov blanket discovery algorithm via local learning within single pass

Canadian AI'08 Proceedings of the Canadian Society for computational studies of intelligence, 21st conference on Advances in artificial intelligence
A heuristic partial-correlation-based algorithm for causal relationship discovery on continuous data

IDEAL'09 Proceedings of the 10th international conference on Intelligent data engineering and automated learning
Feature subset selection based on Bayesian networks

FSKD'09 Proceedings of the 6th international conference on Fuzzy systems and knowledge discovery - Volume 1
Learning locally minimax optimal Bayesian networks

International Journal of Approximate Reasoning
Empirical analysis of an on-line adaptive system using a mixture of Bayesian networks

Information Sciences: an International Journal
Learning Bayesian networks from survival data using weighting censored instances

Journal of Biomedical Informatics
An efficient causal discovery algorithm for linear models

Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining
Bayesian belief network learning algorithms for modeling contextual relationships in natural imagery: a comparative study

Artificial Intelligence Review
Constructing the Bayesian network structure from dependencies implied in multiple relational schemas

Expert Systems with Applications: An International Journal
Matching office firms types and location characteristics: An exploratory analysis using Bayesian classifier networks

Expert Systems with Applications: An International Journal
A hybrid method for learning Bayesian networks based on ant colony optimization

Applied Soft Computing
A new method of learning Bayesian networks structures from incomplete data

ICANN'05 Proceedings of the 15th international conference on Artificial neural networks: formal models and their applications - Volume Part II
An empirical study of massively parallel bayesian networks learning for sentiment extraction from unstructured text

APWeb'11 Proceedings of the 13th Asia-Pacific web conference on Web technologies and applications
Bereitschaftspotential modeling by DBNM and its application to BCI

HI'11 Proceedings of the 2011 international conference on Human interface and the management of information - Volume Part I
How good are the bayesian information criterion and the minimum description length principle for model selection? a bayesian network analysis

MICAI'06 Proceedings of the 5th Mexican international conference on Artificial Intelligence
Automatic video annotation and retrieval based on bayesian inference

MMM'07 Proceedings of the 13th international conference on Multimedia Modeling - Volume Part I
Learning bayesian networks structures based on memory binary particle swarm optimization

SEAL'06 Proceedings of the 6th international conference on Simulated Evolution And Learning
Using the structure of d-connecting paths as a qualitative measure of the strength of dependence

UAI'03 Proceedings of the Nineteenth conference on Uncertainty in Artificial Intelligence
An improved bayesian network learning algorithm based on dependency analysis

CIS'05 Proceedings of the 2005 international conference on Computational Intelligence and Security - Volume Part I
Learning bayesian networks structure with continuous variables

ADMA'06 Proceedings of the Second international conference on Advanced Data Mining and Applications
A new polynomial time algorithm for bayesian network structure learning

ADMA'06 Proceedings of the Second international conference on Advanced Data Mining and Applications
Risk prediction for postoperative morbidity of endovascular aneurysm repair using ensemble model

ICCSA'10 Proceedings of the 2010 international conference on Computational Science and Its Applications - Volume Part III
Player modeling impact on player's entertainment in computer games

UM'05 Proceedings of the 10th international conference on User Modeling
Alert systems for production plants: a methodology based on conflict analysis

ECSQARU'05 Proceedings of the 8th European conference on Symbolic and Quantitative Approaches to Reasoning with Uncertainty
Review: learning bayesian networks: Approaches and issues

The Knowledge Engineering Review
Efficient causal interaction learning with applications in microarray

ISMIS'05 Proceedings of the 15th international conference on Foundations of Intelligent Systems
Learning bayesian networks structures from incomplete data: an efficient approach based on extended evolutionary programming

PAKDD'05 Proceedings of the 9th Pacific-Asia conference on Advances in Knowledge Discovery and Data Mining
Bayesian networks learning for gene expression datasets

IDA'05 Proceedings of the 6th international conference on Advances in Intelligent Data Analysis
Application of Bayesian networks in prognostics for a new Integrated Vehicle Health Management concept

Expert Systems with Applications: An International Journal
Coupling bayesian networks with GIS-Based cellular automata for modeling land use change

GIScience'06 Proceedings of the 4th international conference on Geographic Information Science
The inference of breast cancer metastasis through gene regulatory networks

Journal of Biomedical Informatics
Automatic annotation and retrieval for videos

PSIVT'06 Proceedings of the First Pacific Rim conference on Advances in Image and Video Technology
Monitoring and improving Greek banking services using Bayesian Networks: An analysis of mystery shopping data

Expert Systems with Applications: An International Journal
Development of a computer game-based framework for cognitive behaviour identification by using Bayesian inference methods

Computers in Human Behavior
An optimization-based approach for the design of Bayesian networks

Mathematical and Computer Modelling: An International Journal
Intelligent Postoperative Morbidity Prediction of Heart Disease Using Artificial Intelligence Techniques

Journal of Medical Systems
Learning Causal Relations in Multivariate Time Series Data

ACM Transactions on Intelligent Systems and Technology (TIST)
Analysis of Markov Boundary Induction in Bayesian Networks: A New View From Matroid Theory

Fundamenta Informaticae
Learning bayesian networks from Markov random fields: An efficient algorithm for linear models

ACM Transactions on Knowledge Discovery from Data (TKDD)
Parallel Bayesian network structure learning with application to gene networks

SC '12 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
A Markov blanket based strategy to optimize the induction of Bayesian classifiers when using conditional independence learning algorithms

DaWaK'07 Proceedings of the 9th international conference on Data Warehousing and Knowledge Discovery
An experimental comparison of hybrid algorithms for bayesian network structure learning

ECML PKDD'12 Proceedings of the 2012 European conference on Machine Learning and Knowledge Discovery in Databases - Volume Part I
Maximum Likelihood Estimation Over Directed Acyclic Gaussian Graphs

Statistical Analysis and Data Mining
Financial Data Modeling using a Hybrid Bayesian Network Structured Learning Algorithm

International Journal of Cognitive Informatics and Natural Intelligence
The construction of causal networks to estimate coral bleaching intensity

Environmental Modelling & Software
High-dimensional Gaussian graphical model selection: walk summability and local separation criterion

The Journal of Machine Learning Research
Adaptive thresholding in structure learning of a Bayesian network

IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
A Multi-Objective Evolutionary Algorithm for enhancing Bayesian Networks hybrid-based modeling

Computers & Mathematics with Applications
Software project risk analysis using Bayesian networks with causality constraints

Decision Support Systems
Sub-local constraint-based learning of Bayesian networks using a joint dependence criterion

The Journal of Machine Learning Research
Learning optimal bayesian networks: a shortest path perspective

Journal of Artificial Intelligence Research
Profit optimizing customer churn prediction with Bayesian network classifiers

Intelligent Data Analysis - Business Analytics and Intelligent Optimization

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper provides algorithms that use an information-theoretic analysis to learn Bayesian network structures from data. Based on our three-phase learning framework, we develop efficient algorithms that can effectively learn Bayesian networks, requiring only polynomial numbers of conditional independence (CI) tests in typical cases. We provide precise conditions that specify when these algorithms are guaranteed to be correct as well as empirical evidence (from real world applications and simulation tests) that demonstrates that these systems work efficiently and reliably in practice.