What makes an optimization problem hard?
Complexity
Artificial Intelligence
Density-Based Clustering in Spatial Databases: The Algorithm GDBSCAN and Its Applications
Data Mining and Knowledge Discovery
Meta-Learning by Landmarking Various Learning Algorithms
ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
Objective Function Features Providing Barriers to Rapid Global Optimization
Journal of Global Optimization
Evolving combinatorial problem instances that are difficult to solve
Evolutionary Computation
A review of metrics on permutations for search landscape analysis
Computers and Operations Research
Problem difficulty analysis for particle swarm optimization: deception and modality
Proceedings of the first ACM/SIGEVO Summit on Genetic and Evolutionary Computation
Phase transitions and backbones of the asymmetric traveling salesman problem
Journal of Artificial Intelligence Research
Where the really hard problems are
IJCAI'91 Proceedings of the 12th international joint conference on Artificial intelligence - Volume 1
The backbone of the travelling salesperson
IJCAI'05 Proceedings of the 19th international joint conference on Artificial intelligence
An analysis of problem difficulty for a class of optimisation heuristics
EvoCOP'07 Proceedings of the 7th European conference on Evolutionary computation in combinatorial optimization
A genetic algorithm for the index selection problem
EvoWorkshops'03 Proceedings of the 2003 international conference on Applications of evolutionary computing
SATzilla-07: the design and analysis of an algorithm portfolio for SAT
CP'07 Proceedings of the 13th international conference on Principles and practice of constraint programming
Feature selection by maximum marginal diversity: optimality and implications for visual recognition
CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
Property analysis of symmetric travelling salesman problem instances acquired through evolution
EvoCOP'05 Proceedings of the 5th European conference on Evolutionary Computation in Combinatorial Optimization
Review: Measuring instance difficulty for combinatorial optimization problems
Computers and Operations Research
Discovering the suitability of optimisation algorithms by learning from evolved instances
Annals of Mathematics and Artificial Intelligence
Generalising algorithm performance in instance space: a timetabling case study
LION'05 Proceedings of the 5th international conference on Learning and Intelligent Optimization
ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part III
LION'12 Proceedings of the 6th international conference on Learning and Intelligent Optimization
Proceedings of the twelfth workshop on Foundations of genetic algorithms XII
Proceedings of the 15th annual conference companion on Genetic and evolutionary computation
Algorithm runtime prediction: Methods & evaluation
Artificial Intelligence
Towards objective measures of algorithm performance across instance space
Computers and Operations Research
Annals of Mathematics and Artificial Intelligence
Hi-index | 0.00 |
Whether the goal is performance prediction, or insights into the relationships between algorithm performance and instance characteristics, a comprehensive set of meta-data from which relationships can be learned is needed. This paper provides a methodology to determine if the meta-data is sufficient, and demonstrates the critical role played by instance generation methods. Instances of the Travelling Salesman Problem (TSP) are evolved using an evolutionary algorithm to produce distinct classes of instances that are intentionally easy or hard for certain algorithms. A comprehensive set of features is used to characterise instances of the TSP, and the impact of these features on difficulty for each algorithm is analysed. Finally, performance predictions are achieved with high accuracy on unseen instances for predicting search effort as well as identifying the algorithm likely to perform best.