Boolean Feature Discovery in Empirical Learning

Authors:
Giulia Pagallo;David Haussler
Affiliations:
Department of Computer and Information Sciences, University of California, Santa Cruz CA 95064. giulia@saturn.ucsc.edu;Department of Computer and Information Sciences, University of California, Santa Cruz CA 95064. haussler@saturn.ucsc.edu
Venue:
Machine Learning
Year:
1990

Citing 0
Cited 96

A “Microscopic” Study of Minimum Entropy Search in Learning Decomposable Markov Networks

Machine Learning
Pruning Algorithms for Rule Learning

Machine Learning
Control-Sensitive Feature Selection for Lazy Learners

Artificial Intelligence Review - Special issue on lazy learning
Learning from Examples and Membership Queries with Structured Determinations

Machine Learning
Context-sensitive learning methods for text categorization

ACM Transactions on Information Systems (TOIS)
Separate-and-Conquer Rule Learning

Artificial Intelligence Review
Concept Learning and Feature Selection Based on Square-Error Clustering

Machine Learning
A simple, fast, and effective rule learner

AAAI '99/IAAI '99 Proceedings of the sixteenth national conference on Artificial intelligence and the eleventh Innovative applications of artificial intelligence conference innovative applications of artificial intelligence
Constructing X-of-N Attributes for Decision Tree Learning

Machine Learning
An extended transformation approach to inductive logic programming

ACM Transactions on Computational Logic (TOCL) - Special issue devoted to Robert A. Kowalski
Inducing classification and regression trees in first order logic

Relational Data Mining
Propositionalization approaches to relational data mining

Relational Data Mining
Using conjunction of attribute values for classification

Proceedings of the eleventh international conference on Information and knowledge management
Incremental Feature Selection

Applied Intelligence
Automatic Construction of Decision Trees from Data: A Multi-Disciplinary Survey

Data Mining and Knowledge Discovery
A Survey of Methods for Scaling Up Inductive Algorithms

Data Mining and Knowledge Discovery
Induction By Attribute Elimination

IEEE Transactions on Knowledge and Data Engineering
Optimized Rule Induction

IEEE Expert: Intelligent Systems and Their Applications
Many-layered learning

Neural Computation
GA-Based Learning of kDNFns Boolean Formulas

ICES '01 Proceedings of the 4th International Conference on Evolvable Systems: From Biology to Hardware
The Lumberjack Algorithm for Learning Linked Decision Forests

SARA '02 Proceedings of the 4th International Symposium on Abstraction, Reformulation, and Approximation
SOAP: Efficient Feature Selection of Numeric Attributes

IBERAMIA 2002 Proceedings of the 8th Ibero-American Conference on AI: Advances in Artificial Intelligence
A New Algorithm to Select Learning Examples from Learning Data

IDEAL '00 Proceedings of the Second International Conference on Intelligent Data Engineering and Automated Learning, Data Mining, Financial Engineering, and Intelligent Agents
Generalized Graph Colorability and Compressibility of Boolean Formulae

ISAAC '98 Proceedings of the 9th International Symposium on Algorithms and Computation
Induction as Pre-processing

PAKDD '99 Proceedings of the Third Pacific-Asia Conference on Methodologies for Knowledge Discovery and Data Mining
A Scalable Algorithm for Rule Post-pruning of Large Decision Trees

PAKDD '01 Proceedings of the 5th Pacific-Asia Conference on Knowledge Discovery and Data Mining
Extracting Information from the Web for Concept Learning and Collaborative Filtering

ALT '00 Proceedings of the 11th International Conference on Algorithmic Learning Theory
Feature Transformation and Multivariate Decision Tree Induction

DS '98 Proceedings of the First International Conference on Discovery Science
Learning with Globally Predictive Tests

DS '98 Proceedings of the First International Conference on Discovery Science
Combining Divide-and-Conquer and Separate-and-Conquer for Efficient and Effective Rule Induction

ILP '99 Proceedings of the 9th International Workshop on Inductive Logic Programming
Data reduction: feature aggregation

Handbook of data mining and knowledge discovery
The pitfalls of knowledge discovery in databases and data mining

Data mining
Learning from Cluster Examples

Machine Learning
ART: A Hybrid Classification Model

Machine Learning
Classifying biological articles using web resources

Proceedings of the 2004 ACM symposium on Applied computing
Classification Using Φ-Machines and Constructive Function Approximation

Machine Learning
Simplifying decision trees: A survey

The Knowledge Engineering Review
Redundant feature elimination for multi-class problems

ICML '04 Proceedings of the twenty-first international conference on Machine learning
Learning and Exploiting Relative Weaknesses of Opponent Agents

Autonomous Agents and Multi-Agent Systems
ROC 'n' rule learning: towards a better understanding of covering algorithms

Machine Learning
Constructive induction and genetic algorithms for learning concepts with complex interaction

GECCO '05 Proceedings of the 7th annual conference on Genetic and evolutionary computation
Propositionalization-based relational subgroup discovery with RSD

Machine Learning
Fast feature selection by means of projections

IEA/AIE'2003 Proceedings of the 16th international conference on Developments in applied artificial intelligence
A Study of Structural and Parametric Learning in XCS

Evolutionary Computation
Interestingness measures for data mining: A survey

ACM Computing Surveys (CSUR)
Learning probabilistic decision trees for AUC

Pattern Recognition Letters - Special issue: ROC analysis in pattern recognition
The effect of threshold values on association rule based classification accuracy

Data & Knowledge Engineering
Feature set decomposition for decision trees

Intelligent Data Analysis
Resolving rule conflicts with double induction

Intelligent Data Analysis
Diminishing downsides of Data Mining

International Journal of Business Intelligence and Data Mining
A Genetic-Based Feature Construction Method for Data Summarisation

ADMA '08 Proceedings of the 4th international conference on Advanced Data Mining and Applications
Readable and Accurate Rulesets with ORGA

Proceedings of the 10th international conference on Parallel Problem Solving from Nature: PPSN X
Dynamic Aggregation of Relational Attributes Based on Feature Construction

ADBIS '08 Proceedings of the 12th East European conference on Advances in Databases and Information Systems
Supervised machine learning algorithms for protein structure classification

Computational Biology and Chemistry
An evolutionary approach to constructive induction for link discovery

Proceedings of the 11th Annual Conference Companion on Genetic and Evolutionary Computation Conference: Late Breaking Papers
Analytical features: a knowledge-based approach to audio feature generation

EURASIP Journal on Audio, Speech, and Music Processing
Representing conditional independence using decision trees

AAAI'05 Proceedings of the 20th national conference on Artificial intelligence - Volume 2
Wikipedia-based semantic interpretation for natural language processing

Journal of Artificial Intelligence Research
A system for induction of oblique decision trees

Journal of Artificial Intelligence Research
Rerepresenting and restructuring domain theories: a constructive induction approach

Journal of Artificial Intelligence Research
An analysis of reduced error pruning

Journal of Artificial Intelligence Research
Adaptive web sites: conceptual cluster mining

IJCAI'99 Proceedings of the 16th international joint conference on Artifical intelligence - Volume 1
Process-oriented estimation of generalization error

IJCAI'99 Proceedings of the 16th international joint conference on Artificial intelligence - Volume 2
Automatic abstraction in component-based diagnosis driven by system observability

IJCAI'03 Proceedings of the 18th international joint conference on Artificial intelligence
A scheme for feature construction and a comparison of empirical methods

IJCAI'91 Proceedings of the 12th international joint conference on Artificial intelligence - Volume 2
Transaction-item association matrix-based frequent pattern network mining algorithm in large-scale transaction database

WSEAS Transactions on Computers
Intermediate decision trees

IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 2
Oblivious decision trees graphs and top down pruning

IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 2
Hierarchical decision rules mining

Expert Systems with Applications: An International Journal
Learning of model parameters for fault diagnosis in wireless networks

Wireless Networks
Genetic programming for attribute construction in data mining

EuroGP'03 Proceedings of the 6th European conference on Genetic programming
The lumberjack algorithm for learning linked decision forests

PRICAI'00 Proceedings of the 6th Pacific Rim international conference on Artificial intelligence
Generation of globally relevant continuous features for classification

PAKDD'08 Proceedings of the 12th Pacific-Asia conference on Advances in knowledge discovery and data mining
Apply a rough set-based classifier to dependency parsing

RSKT'08 Proceedings of the 3rd international conference on Rough sets and knowledge technology
Separate-and-conquer knowledge reduction

FSKD'09 Proceedings of the 6th international conference on Fuzzy systems and knowledge discovery - Volume 2
Input space reduction for rule based classification

WSEAS Transactions on Information Science and Applications
Learning with many irrelevant features

AAAI'91 Proceedings of the ninth National conference on Artificial intelligence - Volume 2
A minimal encoding approach to feature discovery

AAAI'91 Proceedings of the ninth National conference on Artificial intelligence - Volume 2
Learning to learn decision trees

AAAI'92 Proceedings of the tenth national conference on Artificial intelligence
Complementary discrimination learning with decision lists

AAAI'92 Proceedings of the tenth national conference on Artificial intelligence
Empirical analysis of the general utility problem in machine learning

AAAI'92 Proceedings of the tenth national conference on Artificial intelligence
Forming concepts for fast inference

AAAI'92 Proceedings of the tenth national conference on Artificial intelligence
Finding accurate frontiers: a knowledge-intensive approach to relational learning

AAAI'93 Proceedings of the eleventh national conference on Artificial intelligence
Generating C4.5 production rules in parallel

AAAI'97/IAAI'97 Proceedings of the fourteenth national conference on artificial intelligence and ninth conference on Innovative applications of artificial intelligence
An efficient algorithm for finding optimal gain-ratio multiple-split tests on hierarchical attributes in decision tree learning

AAAI'96 Proceedings of the thirteenth national conference on Artificial intelligence - Volume 1
Lazy decision trees

AAAI'96 Proceedings of the thirteenth national conference on Artificial intelligence - Volume 1
Generation of attributes for learning algorithms

AAAI'96 Proceedings of the thirteenth national conference on Artificial intelligence - Volume 1
Sequential covering rule induction algorithm for variable consistency rough set approaches

Information Sciences: an International Journal
Decisions: algebra and implementation

MLDM'11 Proceedings of the 7th international conference on Machine learning and data mining in pattern recognition
Interpreting hidden neurons in boolean constructive neural networks

IDEAL'11 Proceedings of the 12th international conference on Intelligent data engineering and automated learning
Critical remarks on single link search in learning belief networks

UAI'96 Proceedings of the Twelfth international conference on Uncertainty in artificial intelligence
Feature selection based on relative attribute dependency: an experimental study

RSFDGrC'05 Proceedings of the 10th international conference on Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing - Volume Part I
Feature discovery in classification problems

IDA'05 Proceedings of the 6th international conference on Advances in Intelligent Data Analysis
Embedding monte carlo search of features in tree-based ensemble methods

ECML PKDD'12 Proceedings of the 2012 European conference on Machine Learning and Knowledge Discovery in Databases - Volume Part I
Unsupervised feature construction for improving data representation and semantics

Journal of Intelligent Information Systems
On the feature extraction in discrete space

Pattern Recognition

Quantified Score

Hi-index	0.00

Visualization

Abstract

We investigate the problem of learning Boolean functions with a short DNF representation using decision trees as a concept description language. Unfortunately, Boolean concepts with a short description may not have a small decision tree representation when the tests at the nodes are limited to the primitive attributes. This representational shortcoming may be overcome by using Boolean features at the decision nodes. We present two new methods that adaptively introduce relevant features while learning a decision tree from examples. We show empirically that these methods outperform a standard decision tree algorithm for learning small random DNF functions when the examples are drawn at random from the uniform distribution.