Top-down induction of first-order logical decision trees

Authors:
Hendrik Blockeel;Luc De Raedt
Affiliations:
Katholieke Universiteit Leuven, Department of Computer Science Celestijnenlaan 200A, 3001 Heverlee, Belgium;Katholieke Universiteit Leuven, Department of Computer Science Celestijnenlaan 200A, 3001 Heverlee, Belgium
Venue:
Artificial Intelligence
Year:
1998

Citing 21
Cited 79

Foundations of logic programming; (2nd extended ed.)

Foundations of logic programming; (2nd extended ed.)
Knowledge intensive induction

Proceedings of the sixth international workshop on Machine learning
C4.5: programs for machine learning

C4.5: programs for machine learning
First-order jk-clausal theories are PAC-learnable

Artificial Intelligence
Theories for mutagenicity: a study in first-order and feature-based induction

Artificial Intelligence - Special volume on empirical methods
Solving the multiple instance problem with axis-parallel rectangles

Artificial Intelligence
PROLOG Programming for Artificial Intelligence

PROLOG Programming for Artificial Intelligence
Incremental Induction of Decision Trees

Machine Learning
The CN2 Induction Algorithm

Machine Learning
Induction of Decision Trees

Machine Learning
On Multi-class Problems and Discretization in Inductive Logic Programming

ISMIS '97 Proceedings of the 10th International Symposium on Foundations of Intelligent Systems
Applying ILP to Diterpene Structure Elucidation from 13C NMR Spectra

ILP '96 Selected Papers from the 6th International Workshop on Inductive Logic Programming
Using Logical Decision Trees for Clustering

ILP '97 Proceedings of the 7th International Workshop on Inductive Logic Programming
Lookahead and Discretization in ILP

ILP '97 Proceedings of the 7th International Workshop on Inductive Logic Programming
Induction of first-order decision lists: results on learning the past tense of English verbs

Journal of Artificial Intelligence Research
Learning first-order definitions of functions

Journal of Artificial Intelligence Research
Learning first-order definitions of functions

Journal of Artificial Intelligence Research
Learning structural decision trees from examples

IJCAI'91 Proceedings of the 12th international joint conference on Artificial intelligence - Volume 2
Covering vs divide-and-conquer for top-down induction of logic programs

IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 2
Bagging, boosting, and C4.S

AAAI'96 Proceedings of the thirteenth national conference on Artificial intelligence - Volume 1
Structural regression trees

AAAI'96 Proceedings of the thirteenth national conference on Artificial intelligence - Volume 1

Speeding Up Relational Reinforcement Learning through the Use of an Incremental First Order Decision Tree Learner

EMCL '01 Proceedings of the 12th European Conference on Machine Learning
Multi-Relational Data Mining, Using UML for ILP

PKDD '00 Proceedings of the 4th European Conference on Principles of Data Mining and Knowledge Discovery
Learning in Clausal Logic: A Perspective on Inductive Logic Programming

Computational Logic: Logic Programming and Beyond, Essays in Honour of Robert A. Kowalski, Part I
How to Upgrade Propositional Learners to First Order Logic: A Case Study

Machine Learning and Its Applications, Advanced Lectures
Model Class Selection and Construction: Beyond the Procrustean Approach to Machine Learning Applications

Machine Learning and Its Applications, Advanced Lectures
Learning a Go Heuristic with TILDE

CG '00 Revised Papers from the Second International Conference on Computers and Games
Executing Query Packs in ILP

ILP '00 Proceedings of the 10th International Conference on Inductive Logic Programming
Efficient Cross-Validation in ILP

ILP '01 Proceedings of the 11th International Conference on Inductive Logic Programming
Morphosyntactic Tagging of Slovene Using Progol

ILP '99 Proceedings of the 9th International Workshop on Inductive Logic Programming
Statistical Relational Learning for Document Mining

ICDM '03 Proceedings of the Third IEEE International Conference on Data Mining
Inductive Logic Programming for Gene Regulation Prediction

Inductive Logic Programming
Extension of the Top-Down Data-Driven Strategy to ILP

Inductive Logic Programming
Efficient and Scalable Induction of Logic Programs Using a Deductive Database System

Inductive Logic Programming
ReMauve: A Relational Model Tree Learner

Inductive Logic Programming
Pruning Relations for Substructure Discovery of Multi-relational Databases

PKDD 2007 Proceedings of the 11th European conference on Principles and Practice of Knowledge Discovery in Databases
Feature Discovery with Type Extension Trees

ILP '08 Proceedings of the 18th international conference on Inductive Logic Programming
Hierarchical Distance-Based Conceptual Clustering

ECML PKDD '08 Proceedings of the 2008 European Conference on Machine Learning and Knowledge Discovery in Databases - Part I
Ensemble-Trees: Leveraging Ensemble Power Inside Decision Trees

DS '08 Proceedings of the 11th International Conference on Discovery Science
Towards Machine Learning on the Semantic Web

Uncertainty Reasoning for the Semantic Web I
Combining Multiple Interrelated Streams for Incremental Clustering

SSDBM 2009 Proceedings of the 21st International Conference on Scientific and Statistical Database Management
Drugs and Drug-Like Compounds: Discriminating Approved Pharmaceuticals from Screening-Library Compounds

PRIB '09 Proceedings of the 4th IAPR International Conference on Pattern Recognition in Bioinformatics
Discovering Knowledge from Multi-relational Data Based on Information Retrieval Theory

ADMA '09 Proceedings of the 5th International Conference on Advanced Data Mining and Applications
Ensemble methods for noise elimination in classification problems

MCS'03 Proceedings of the 4th international conference on Multiple classifier systems
Efficient and effective induction of first order decision lists

ILP'02 Proceedings of the 12th international conference on Inductive logic programming
Mining frequent logical sequences with SPIRIT-LoG

ILP'02 Proceedings of the 12th international conference on Inductive logic programming
Compact representation of knowledge bases in ILP

ILP'02 Proceedings of the 12th international conference on Inductive logic programming
Learning relational options for inductive transfer in relational reinforcement learning

ILP'07 Proceedings of the 17th international conference on Inductive logic programming
Seeing the forest through the trees: learning a comprehensible model from a first order ensemble

ILP'07 Proceedings of the 17th international conference on Inductive logic programming
Building relational world models for reinforcement learning

ILP'07 Proceedings of the 17th international conference on Inductive logic programming
Process mining as first-order classification learning on logs with negative events

BPM'07 Proceedings of the 2007 international conference on Business process management
RedTrees: A relational decision tree algorithm in streams

Expert Systems with Applications: An International Journal
Three complementary approaches to context aware movie recommendation

Proceedings of the Workshop on Context-Aware Movie Recommendation
Similarity-Based Classification in Relational Databases

Fundamenta Informaticae
Induction of concepts in web ontologies through terminological decision trees

ECML PKDD'10 Proceedings of the 2010 European conference on Machine learning and knowledge discovery in databases: Part I
Automatic induction of bellman-error features for probabilistic planning

Journal of Artificial Intelligence Research
Induction of relational algebra expressions

ILP'09 Proceedings of the 19th international conference on Inductive logic programming
Incorporating linguistic expertise using ILP for named entity recognition in data hungry Indian languages

ILP'09 Proceedings of the 19th international conference on Inductive logic programming
Jason induction of logical decision trees: a learning library and its application to commitment

MICAI'10 Proceedings of the 9th Mexican international conference on Advances in artificial intelligence: Part I
Process discovery in event logs: An application in the telecom industry

Applied Soft Computing
S.cerevisiae complex function prediction with modular multi-relational framework

IEA/AIE'10 Proceedings of the 23rd international conference on Industrial engineering and other applications of applied intelligent systems - Volume Part III
A general multi-relational classification approach using feature generation and selection

ADMA'10 Proceedings of the 6th international conference on Advanced data mining and applications - Volume Part II
A Monte-Carlo AIXI approximation

Journal of Artificial Intelligence Research
Scaling up heuristic planning with relational decision trees

Journal of Artificial Intelligence Research
Learning multi-class theories in ILP

ILP'10 Proceedings of the 20th international conference on Inductive logic programming
MMRF for Proteome annotation applied to human protein disease prediction

ILP'10 Proceedings of the 20th international conference on Inductive logic programming
BET: an inductive logic programming workbench

ILP'10 Proceedings of the 20th international conference on Inductive logic programming
Boosting tuple propagation in multi-relational classification

Proceedings of the 15th Symposium on International Database Engineering & Applications
Learning in BDI multi-agent systems

CLIMA IV'04 Proceedings of the 4th international conference on Computational Logic in Multi-Agent Systems
Refining aggregate conditions in relational learning

PKDD'06 Proceedings of the 10th European conference on Principle and Practice of Knowledge Discovery in Databases
From inductive logic programming to relational data mining

JELIA'06 Proceedings of the 10th European conference on Logics in Artificial Intelligence
TildeCRF: conditional random fields for logical sequences

ECML'06 Proceedings of the 17th European conference on Machine Learning
An efficient approximation to lookahead in relational learners

ECML'06 Proceedings of the 17th European conference on Machine Learning
Privacy leakage in multi-relational learning via unwanted classification models

Proceedings of the 2011 Conference of the Center for Advanced Studies on Collaborative Research
Efficient classification from multiple heterogeneous databases

PKDD'05 Proceedings of the 9th European conference on Principles and Practice of Knowledge Discovery in Databases
Hierarchical multi-classification with predictive clustering trees in functional genomics

EPIA'05 Proceedings of the 12th Portuguese conference on Progress in Artificial Intelligence
Relational pattern updating

Information Sciences: an International Journal
Using trees to mine multirelational databases

Data Mining and Knowledge Discovery
A comparison of approaches for learning probability trees

ECML'05 Proceedings of the 16th European conference on Machine Learning
Logical bayesian networks and their relation to other probabilistic logical models

ILP'05 Proceedings of the 15th international conference on Inductive Logic Programming
Predicate selection for structural decision trees

ILP'05 Proceedings of the 15th international conference on Inductive Logic Programming
CLASSIC'CL: an integrated ILP system

DS'05 Proceedings of the 8th international conference on Discovery Science
Modelling Shared Attention Through Relational Reinforcement Learning

Journal of Intelligent and Robotic Systems
Stochastic abstract policies for knowledge transfer in robotic navigation tasks

MICAI'11 Proceedings of the 10th Mexican international conference on Advances in Artificial Intelligence - Volume Part I
SmartGantt - An intelligent system for real time rescheduling based on relational reinforcement learning

Expert Systems with Applications: An International Journal
A multi-dimensional quality assessment of state-of-the-art process discovery algorithms using real-life event logs

Information Systems
Learning compact markov logic networks with decision trees

ILP'11 Proceedings of the 21st international conference on Inductive Logic Programming
Expressive power of safe first-order logical decision trees

ILP'11 Proceedings of the 21st international conference on Inductive Logic Programming
Improved artificial negative event generation to enhance process event logs

CAiSE'12 Proceedings of the 24th international conference on Advanced Information Systems Engineering
Learning from Skewed Class Multi-relational Databases

Fundamenta Informaticae - Progress on Multi-Relational Data Mining
Combining heterogeneous classifiers for relational databases

Pattern Recognition
Constructing a Decision Tree for Graph-Structured Data and its Applications

Fundamenta Informaticae - Advances in Mining Graphs, Trees and Sequences
Relational differential prediction

ECML PKDD'12 Proceedings of the 2012 European conference on Machine Learning and Knowledge Discovery in Databases - Volume Part I
Simple decision forests for multi-relational classification

Decision Support Systems
Reducing the size of databases for multirelational classification: a subgraph-based approach

Journal of Intelligent Information Systems
Context-Aware predictions on business processes: an ensemble-based solution

NFMCP'12 Proceedings of the First international conference on New Frontiers in Mining Complex Patterns
Exploration in relational domains for model-based reinforcement learning

The Journal of Machine Learning Research
Type Extension Trees for feature construction and learning in relational domains

Artificial Intelligence
Towards a Self-Learning Agent: Using Ranking Functions as a Belief Representation in Reinforcement Learning

Neural Processing Letters
Enhancing understanding and improving prediction of severe weather through spatiotemporal relational learning

Machine Learning

Quantified Score

Hi-index	0.00

Visualization

Abstract

A first-order framework for top-down induction of logical decision trees is introduced. The expressivity of these trees is shown to be larger than that of the flat logic programs which are typically induced by classical ILP systems, and equal to that of first-order decision lists. These results are related to predicate invention and mixed variable quantification. Finally, an implementation of this framework, the TILDE system, is presented and empirically evaluated.