Characterizing the applicability of classification algorithms using meta-level learning
ECML-94 Proceedings of the European conference on machine learning on Machine Learning
Machine learning, neural and statistical classification
Artificial Intelligence Review - Special issue on lazy learning
The process of knowledge discovery in databases
Advances in knowledge discovery and data mining
Reinforcement learning with self-modifying policies
Learning to learn
Meta Analysis of Classification Algorithms for Pattern Recognition
IEEE Transactions on Pattern Analysis and Machine Intelligence
Machine Learning
Pattern Recognition and Neural Networks
Pattern Recognition and Neural Networks
Combining Classifiers with Meta Decision Trees
Machine Learning
Characterization of Classification Algorithms
EPIA '95 Proceedings of the 7th Portuguese Conference on Artificial Intelligence: Progress in Artificial Intelligence
Generalizing from Case studies: A Case Study
ML '92 Proceedings of the Ninth International Workshop on Machine Learning
ICML '97 Proceedings of the Fourteenth International Conference on Machine Learning
Meta-Learning by Landmarking Various Learning Algorithms
ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
Experiments in Meta-level Learning with ILP
PKDD '99 Proceedings of the Third European Conference on Principles of Data Mining and Knowledge Discovery
AST: Support for Algorithm Selection with a CBR Approach
PKDD '99 Proceedings of the Third European Conference on Principles of Data Mining and Knowledge Discovery
Introduction to the Special Issue on Meta-Learning
Machine Learning
On Data and Algorithms: Understanding Inductive Performance
Machine Learning
Predicting relative performance of classifiers from samples
ICML '05 Proceedings of the 22nd international conference on Machine learning
Selecting parameters of SVM using meta-learning and kernel matrix-based meta-features
Proceedings of the 2006 ACM symposium on Applied computing
Selective fusion of heterogeneous classifiers
Intelligent Data Analysis
Machine learning: a review of classification and combining techniques
Artificial Intelligence Review
Mindful: A framework for Meta-INDuctive neuro-FUzzy Learning
Information Sciences: an International Journal
Selective generation of training examples in active meta-learning
International Journal of Hybrid Intelligent Systems - HIS 2007
Label ranking by learning pairwise preferences
Artificial Intelligence
Towards MKDA: A Knowledge Discovery Assistant for Researches in Medicine
AI*IA '07 Proceedings of the 10th Congress of the Italian Association for Artificial Intelligence on AI*IA 2007: Artificial Intelligence and Human-Oriented Computing
Meta-learning with Machine Generators and Complexity Controlled Exploration
ICAISC '08 Proceedings of the 9th international conference on Artificial Intelligence and Soft Computing
ICAISC '08 Proceedings of the 9th international conference on Artificial Intelligence and Soft Computing
Predicting the Performance of Learning Algorithms Using Support Vector Machines as Meta-regressors
ICANN '08 Proceedings of the 18th international conference on Artificial Neural Networks, Part I
Cross-disciplinary perspectives on meta-learning for algorithm selection
ACM Computing Surveys (CSUR)
UCI++: Improved Support for Algorithm Selection Using Datasetoids
PAKDD '09 Proceedings of the 13th Pacific-Asia Conference on Advances in Knowledge Discovery and Data Mining
Supervised Machine Learning: A Review of Classification Techniques
Proceedings of the 2007 conference on Emerging Artificial Intelligence Applications in Computer Engineering: Real Word AI Systems with Applications in eHealth, HCI, Information Retrieval and Pervasive Technologies
Active Generation of Training Examples in Meta-Regression
ICANN '09 Proceedings of the 19th International Conference on Artificial Neural Networks: Part I
An Analysis of Meta-learning Techniques for Ranking Clustering Algorithms Applied to Artificial Data
ICANN '09 Proceedings of the 19th International Conference on Artificial Neural Networks: Part I
ICANN '09 Proceedings of the 19th International Conference on Artificial Neural Networks: Part II
On the Importance of Comprehensible Classification Models for Protein Function Prediction
IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Active learning to support the generation of meta-examples
ICANN'07 Proceedings of the 17th international conference on Artificial neural networks
An iterative process for building learning curves and predicting relative performance of classifiers
EPIA'07 Proceedings of the aritficial intelligence 13th Portuguese conference on Progress in artificial intelligence
ISMIS'08 Proceedings of the 17th international conference on Foundations of intelligent systems
Active Testing Strategy to Predict the Best Classification Algorithm via Sampling and Metalearning
Proceedings of the 2010 conference on ECAI 2010: 19th European Conference on Artificial Intelligence
Task management in advanced computational intelligence system
ICAISC'10 Proceedings of the 10th international conference on Artificial intelligence and soft computing: Part I
Mapping classifiers and datasets
Expert Systems with Applications: An International Journal
DS'10 Proceedings of the 13th international conference on Discovery science
Auto-experimentation of KDD workflows based on ontological planning
ISWC'10 Proceedings of the 9th international semantic web conference on The semantic web - Volume Part II
Control of complex machines for meta-learning in computational intelligence
CIMMACS'07 Proceedings of the 6th WSEAS international conference on Computational intelligence, man-machine systems and cybernetics
Combining meta-learning and active selection of datasetoids for algorithm selection
HAIS'11 Proceedings of the 6th international conference on Hybrid artificial intelligent systems - Volume Part I
Mining association rules for label ranking
PAKDD'11 Proceedings of the 15th Pacific-Asia conference on Advances in knowledge discovery and data mining - Volume Part II
Review: Measuring instance difficulty for combinatorial optimization problems
Computers and Operations Research
Linear dimension reduction in classification: adaptive procedure for optimum results
Advances in Data Analysis and Classification
Learning from label preferences
DS'11 Proceedings of the 14th international conference on Discovery science
Prediction of classifier training time including parameter optimization
KI'11 Proceedings of the 34th Annual German conference on Advances in artificial intelligence
Protein classification with multiple algorithms
PCI'05 Proceedings of the 10th Panhellenic conference on Advances in Informatics
Meta-data: characterization of input features for meta-learning
MDAI'05 Proceedings of the Second international conference on Modeling Decisions for Artificial Intelligence
KDD support services based on data semantics
Journal on Data Semantics IV
A landmarker selection algorithm based on correlation and efficiency criteria
AI'04 Proceedings of the 17th Australian joint conference on Advances in Artificial Intelligence
Combining Uncertainty Sampling methods for supporting the generation of meta-examples
Information Sciences: an International Journal
Selecting classification algorithms with active testing
MLDM'12 Proceedings of the 8th international conference on Machine Learning and Data Mining in Pattern Recognition
Identifying characteristics of seaports for environmental benchmarks based on meta-learning
PKAW'12 Proceedings of the 12th Pacific Rim conference on Knowledge Management and Acquisition for Intelligent Systems
ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part III
Clustering algorithm recommendation: a meta-learning approach
SEMCCO'12 Proceedings of the Third international conference on Swarm, Evolutionary, and Memetic Computing
Flexible Algorithm Selection Framework for Large Scale Metalearning
WI-IAT '12 Proceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 01
A Novel Meta Learning System and Its Application to Optimization of Computing Agents' Results
WI-IAT '12 Proceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 02
Auto-WEKA: combined selection and hyperparameter optimization of classification algorithms
Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining
Segmentation of neuronal nuclei based on clump splitting and a two-step binarization of images
Expert Systems with Applications: An International Journal
Information Technology and Management
Pairwise meta-rules for better meta-learning-based algorithm ranking
Machine Learning
Efficient feature size reduction via predictive forward selection
Pattern Recognition
A feature subset selection algorithm automatic recommendation method
Journal of Artificial Intelligence Research
Contrasting meta-learning and hyper-heuristic research: the role of evolutionary algorithms
Genetic Programming and Evolvable Machines
Predicting execution time of machine learning tasks for scheduling
International Journal of Hybrid Intelligent Systems
A metric for unsupervised metalearning
Intelligent Data Analysis
Automatic selection of classification learning algorithms for data mining practitioners
Intelligent Data Analysis
A novel feature subset selection algorithm based on association rule mining
Intelligent Data Analysis
Hi-index | 0.00 |
We present a meta-learning method to support selection of candidate learning algorithms. It uses a k-Nearest Neighbor algorithm to identify the datasets that are most similar to the one at hand. The distance between datasets is assessed using a relatively small set of data characteristics, which was selected to represent properties that affect algorithm performance. The performance of the candidate algorithms on those datasets is used to generate a recommendation to the user in the form of a ranking. The performance is assessed using a multicriteria evaluation measure that takes not only accuracy, but also time into account. As it is not common in Machine Learning to work with rankings, we had to identify and adapt existing statistical techniques to devise an appropriate evaluation methodology. Using that methodology, we show that the meta-learning method presented leads to significantly better rankings than the baseline ranking method. The evaluation methodology is general and can be adapted to other ranking problems. Although here we have concentrated on ranking classification algorithms, the meta-learning framework presented can provide assistance in the selection of combinations of methods or more complex problem solving strategies.