Dependency networks for inference, collaborative filtering, and data visualization

Authors:
David Heckerman;David Maxwell Chickering;Christopher Meek;Robert Rounthwaite;Carl Kadie
Affiliations:
Microsoft Research, One Microsoft Way, Redmond, WA;Microsoft Research, One Microsoft Way, Redmond, WA;Microsoft Research, One Microsoft Way, Redmond, WA>;Microsoft Research, One Microsoft Way, Redmond, WA;Microsoft Research, One Microsoft Way, Redmond, WA
Venue:
The Journal of Machine Learning Research
Year:
2001

Citing 10
Cited 116

Probabilistic reasoning in intelligent systems: networks of plausible inference

Probabilistic reasoning in intelligent systems: networks of plausible inference
Theory refinement on Bayesian networks

Proceedings of the seventh conference (1991) on Uncertainty in artificial intelligence
GroupLens: an open architecture for collaborative filtering of netnews

CSCW '94 Proceedings of the 1994 ACM conference on Computer supported cooperative work
Fast training of support vector machines using sequential minimal optimization

Advances in kernel methods
Nonlinear Markov networks for continuous variables

NIPS '97 Proceedings of the 1997 conference on Advances in neural information processing systems 10
Neural Networks for Pattern Recognition

Neural Networks for Pattern Recognition
Empirical analysis of predictive algorithms for collaborative filtering

UAI'98 Proceedings of the Fourteenth conference on Uncertainty in artificial intelligence
A Bayesian approach to learning Bayesian networks with local structure

UAI'97 Proceedings of the Thirteenth conference on Uncertainty in artificial intelligence
Models and selection criteria for regression and classification

UAI'97 Proceedings of the Thirteenth conference on Uncertainty in artificial intelligence
Learning Bayesian networks with local structure

UAI'96 Proceedings of the Twelfth international conference on Uncertainty in artificial intelligence

Probabilistic modeling of transaction data with applications to profiling, visualization, and prediction

Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining
Mining the network value of customers

Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining
Probabilistic combination of text classifiers using reliability indicators: models and results

SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Association Models for Web Mining

Data Mining and Knowledge Discovery
Studying Recommendation Algorithms by Graph Analysis

Journal of Intelligent Information Systems
Reasoning with Classifiers

ECML '02 Proceedings of the 13th European Conference on Machine Learning
Lightweight Collaborative Filtering Method for Binary-Encoded Data

PKDD '01 Proceedings of the 5th European Conference on Principles of Data Mining and Knowledge Discovery
Reasoning with Classifiers

PKDD '02 Proceedings of the 6th European Conference on Principles of Data Mining and Knowledge Discovery
Towards a More Comprehensive Comparison of Collaborative Filtering Algorithms

SPIRE 2002 Proceedings of the 9th International Symposium on String Processing and Information Retrieval
Better Contextual Translation Using Machine Learning

AMTA '02 Proceedings of the 5th Conference of the Association for Machine Translation in the Americas on Machine Translation: From Research to Real Users
Collaborative filtering via gaussian probabilistic latent semantic analysis

Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Recommender systems using linear classifiers

The Journal of Machine Learning Research
Structure Search and Stability Enhancement of Bayesian Networks

ICDM '03 Proceedings of the Third IEEE International Conference on Data Mining
Probabilistic User Behavior Models

ICDM '03 Proceedings of the Third IEEE International Conference on Data Mining
Probabilistic Memory-Based Collaborative Filtering

IEEE Transactions on Knowledge and Data Engineering
Knowing a tree from the forest: art image retrieval using a society of profiles

MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
Evaluating collaborative filtering recommender systems

ACM Transactions on Information Systems (TOIS)
Latent semantic models for collaborative filtering

ACM Transactions on Information Systems (TOIS)
Item-based top-N recommendation algorithms

ACM Transactions on Information Systems (TOIS)
A comparison of several predictive algorithms for collaborative filtering on multi-valued ratings

Proceedings of the 2004 ACM symposium on Applied computing
Enhancing Product Recommender Systems on Sparse Binary Data

Data Mining and Knowledge Discovery
Sparse graphical models for exploring gene expression data

Journal of Multivariate Analysis
The Combination of Text Classifiers Using Reliability Indicators

Information Retrieval
Maximum entropy for collaborative filtering

UAI '04 Proceedings of the 20th conference on Uncertainty in artificial intelligence
A machine learning approach to the automatic evaluation of machine translation

ACL '01 Proceedings of the 39th Annual Meeting on Association for Computational Linguistics
Feature-rich part-of-speech tagging with a cyclic dependency network

NAACL '03 Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - Volume 1
On the collective classification of email "speech acts"

Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Feature-based recommendation system

Proceedings of the 14th ACM international conference on Information and knowledge management
Estimation of Distribution Algorithms with Kikuchi Approximations

Evolutionary Computation
Markov logic networks

Machine Learning
Induction of compact decision trees for personalized recommendation

Proceedings of the 2006 ACM symposium on Applied computing
Latent linkage semantic kernels for collective classification of link data

Journal of Intelligent Information Systems
Learning Contextual Dependency Network Models for Link-Based Classification

IEEE Transactions on Knowledge and Data Engineering
Advances in optimization and prediction techniques: Real-world applications: Thesis

AI Communications
Suboptimal behavior of Bayes and MDL in classification under misspecification

Machine Learning
Relational Dependency Networks

The Journal of Machine Learning Research
Classification in Networked Data: A Toolkit and a Univariate Case Study

The Journal of Machine Learning Research
A collaborative recommender system based on probabilistic inference from fuzzy observations

Fuzzy Sets and Systems
Preference networks: probabilistic models for recommendation systems

AusDM '07 Proceedings of the sixth Australasian conference on Data mining and analytics - Volume 70
Evaluation of recommender systems: A new approach

Expert Systems with Applications: An International Journal
Improved EDNA (estimation of dependency networks algorithm) using combining function with bivariate probability distributions

Proceedings of the 10th annual conference on Genetic and evolutionary computation
Efficient top-k querying over social-tagging networks

Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
The probabilistic program dependence graph and its application to fault diagnosis

ISSTA '08 Proceedings of the 2008 international symposium on Software testing and analysis
BayesRule: A Markov-Blanket based procedure for extracting a set of probabilistic rules from Bayesian classifiers

International Journal of Hybrid Intelligent Systems - HIS 2007
A bias/variance decomposition for models using collective inference

Machine Learning
Learning Bayesian Classifiers from Dependency Network Classifiers

ICANNGA '07 Proceedings of the 8th international conference on Adaptive and Natural Computing Algorithms, Part I
EDNA: Estimation of Dependency Networks Algorithm

IWINAC '07 Proceedings of the 2nd international work-conference on The Interplay Between Natural and Artificial Computation, Part I: Bio-inspired Modeling of Cognitive Tasks
Bayesian Substructure Learning - Approximate Learning of Very Large Network Structures

ECML '07 Proceedings of the 18th European conference on Machine Learning
Collaborative Recommendations Using Bayesian Networks and Linguistic Modelling

ICAISC '08 Proceedings of the 9th international conference on Artificial Intelligence and Soft Computing
Complex adaptive filtering user profile using graphical models

Information Processing and Management: an International Journal
Tied boltzmann machines for cold start recommendations

Proceedings of the 2008 ACM conference on Recommender systems
Use of Radio Frequency Identification for Targeted Advertising: A Collaborative Filtering Approach Using Bayesian Networks

ECSQARU '07 Proceedings of the 9th European Conference on Symbolic and Quantitative Approaches to Reasoning with Uncertainty
Canonical representation of conditionally specified multivariate discrete distributions

Journal of Multivariate Analysis
Using Bayesian networks with rule extraction to infer the risk of weed infestation in a corn-crop

Engineering Applications of Artificial Intelligence
Sparse Gaussian graphical models with unknown block structure

ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Learning structurally consistent undirected probabilistic graphical models

ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Scalable pseudo-likelihood estimation in hybrid random fields

Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining
An Inductive Logic Programming Approach to Statistical Relational Learning

Proceedings of the 2005 conference on An Inductive Logic Programming Approach to Statistical Relational Learning
Bayesian learning of Bayesian networks with informative priors

Annals of Mathematics and Artificial Intelligence
Managing uncertainty in group recommending processes

User Modeling and User-Adapted Interaction
2009 Special Issue: A hybrid random field model for scalable statistical learning

Neural Networks
Learning graphical model structure using L1-regularization paths

AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 2
A unified approach to building hybrid recommender systems

Proceedings of the third ACM conference on Recommender systems
Intelligent integrated data processing model for oceanic warning system

Knowledge-Based Systems
Does explanation improve the acceptance of decision support for product release planning?

ESEM '09 Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement
Scalable statistical learning: a modular Bayesian/Markov network approach

IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
A survey of collaborative filtering techniques

Advances in Artificial Intelligence
Collaborative filtering recommender systems

The adaptive web
Modeling discrete interventional data using directed cyclic graphical models

UAI '09 Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence
Ordinal Boltzmann Machines for collaborative filtering

UAI '09 Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence
ERACER: a database approach for statistical inference and data cleaning

Proceedings of the 2010 ACM SIGMOD International Conference on Management of data
Gibbs ensembles for nearly compatible and incompatible conditional models

Computational Statistics & Data Analysis
Learning factorizations in estimation of distribution algorithms using affinity propagation

Evolutionary Computation
Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion

The Journal of Machine Learning Research
A method of extracting malicious expressions in bulletin board systems by using context analysis

Information Processing and Management: an International Journal
A simple algorithm for checking compatibility among discrete conditional distributions

Computational Statistics & Data Analysis
Integrating knowledge capture and supervised learning through a human-computer interface

Proceedings of the sixth international conference on Knowledge capture
Short communication: Statistical downscaling of rainfall data using sparse variable selection methods

Environmental Modelling & Software
Customization support for CBR-based defect prediction

Proceedings of the 7th International Conference on Predictive Models in Software Engineering
Sparse Linear Identifiable Multivariate Modeling

The Journal of Machine Learning Research
Fusing multiple Bayesian knowledge sources

International Journal of Approximate Reasoning
Users' (Dis)satisfaction with the personalTV application: Combining objective and subjective data

Computers in Entertainment (CIE) - Theoretical and Practical Computer Applications in Entertainment
CFW: a collaborative filtering system using posteriors over weights of evidence

UAI'02 Proceedings of the Eighteenth conference on Uncertainty in artificial intelligence
An MDP-based recommender system

UAI'02 Proceedings of the Eighteenth conference on Uncertainty in artificial intelligence
Using temporal data for making recommendations

UAI'01 Proceedings of the Seventeenth conference on Uncertainty in artificial intelligence
Natural Language Processing (Almost) from Scratch

The Journal of Machine Learning Research
Collaborative ensemble learning: combining collaborative and content-based information filtering via hierarchical bayes

UAI'03 Proceedings of the Nineteenth conference on Uncertainty in Artificial Intelligence
Research paper recommender systems: a subspace clustering approach

WAIM'05 Proceedings of the 6th international conference on Advances in Web-Age Information Management
Robust collective classification with contextual dependency network models

ADMA'06 Proceedings of the Second international conference on Advanced Data Mining and Applications
Predicting query performance via classification

ECIR'2010 Proceedings of the 32nd European conference on Advances in Information Retrieval
Directed cycles in bayesian belief networks: probabilistic semantics and consistency checking complexity

MICAI'05 Proceedings of the 4th Mexican international conference on Advances in Artificial Intelligence
A survey on statistical relational learning

AI'10 Proceedings of the 23rd Canadian conference on Advances in Artificial Intelligence
Addressing users' privacy concerns for improving personalization quality: towards an integration of user studies and algorithm evaluation

ITWP'03 Proceedings of the 2003 international conference on Intelligent Techniques for Web Personalization
Logical bayesian networks and their relation to other probabilistic logical models

ILP'05 Proceedings of the 15th international conference on Inductive Logic Programming
Research Note---The Halo Effect in Multicomponent Ratings and Its Implications for Recommender Systems: The Case of Yahoo! Movies

Information Systems Research
A latent model for collaborative filtering

International Journal of Approximate Reasoning
An exploration of improving collaborative recommender systems via user-item subgroups

Proceedings of the 21st international conference on World Wide Web
Investigating the influence of QoS on personal evaluation behaviour in a mobile context

Multimedia Tools and Applications
Competitiveness analysis of automotive industry in Turkey using Bayesian networks

Expert Systems with Applications: An International Journal
Structured comparative analysis of systems logs to diagnose performance problems

NSDI'12 Proceedings of the 9th USENIX conference on Networked Systems Design and Implementation
Multi-label classification using conditional dependency networks

IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Two
A Markovianity based optimisation algorithm

Genetic Programming and Evolvable Machines
Analysis of Markov Boundary Induction in Bayesian Networks: A New View From Matroid Theory

Fundamenta Informaticae
A review on probabilistic graphical models in evolutionary computation

Journal of Heuristics
Automatic news recommendations via aggregated profiling

Multimedia Tools and Applications
Regularized continuous estimation of distribution algorithms

Applied Soft Computing
Don't be SCAREd: use SCalable Automatic REpairing with maximal likelihood and bounded changes

Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data
A hidden Markov model for collaborative filtering

MIS Quarterly
Deep learning of representations: looking forward

SLSP'13 Proceedings of the First international conference on Statistical Language and Speech Processing
Cyclic causal models with discrete variables: Markov Chain equilibrium semantics and sample ordering

IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Forecasting multi-appliance usage for smart home energy management

IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Two machine-learning techniques for mining solutions of the ReleasePlannerTM decision support system

Information Sciences: an International Journal
On compatibility of discrete full conditional distributions: A graphical representation approach

Journal of Multivariate Analysis
Statistical user model supported by R-Tree structure

Applied Intelligence
Image annotation by modeling Supporting Region Graph

Applied Intelligence
Comprehensible classification models: a position paper

ACM SIGKDD Explorations Newsletter

Quantified Score

Hi-index	0.00

Visualization

Abstract

We describe a graphical model for probabilistic relationships--an alternative to the Bayesian network--called a dependency network. The graph of a dependency network, unlike a Bayesian network, is potentially cyclic. The probability component of a dependency network, like a Bayesian network, is a set of conditional distributions, one for each node given its parents. We identify several basic properties of this representation and describe a computationally efficient procedure for learning the graph and probability components from data. We describe the application of this representation to probabilistic inference, collaborative filtering (the task of predicting preferences), and the visualization of acausal predictive relationships.