Two-Way Induction

• Authors: Pedro Domingos
• Venue: TAI '95 Proceedings of the Seventh International Conference on Tools with Artificial Intelligence
• Year: 1995

General-to-specific learners like ID3 and CN2 perform well when the target concept descriptions are general, but often have difficulties when they are specific or mixed. This problem can be alleviated by combining them with a specific-to-general learning component, resulting in a two-way induction system. In this paper one design for such a component is proposed, as well as two methods for combining the two components. Experiments on artificial domains show the combined learner to match or outperform ``pure'' versions of C4.5 and CN2 across the entire generality spectrum, with the advantage increasing for greater concept specificity. Experiments on 24 real-world domains from the UCI repository confirm the utility of two-way induction: the combined learner achieves higher accuracy than C4.5 in 17 domains (at the 5% significance level in 12), and similar results are obtained with CN2. Closer observation of the system's behavior leads to a better understanding of its ability to correct overly-general rules with specific ones, and shows that there is still room for improvement.