In this paper, we consider the meta-learning problem of metaheuristic optimisation performance prediction as a foundation underlying the task of algorithm selection for solving optimisation problems. The relative effectiveness of a problem-specific versus an algorithm-specific meta-learning approach is ascertained in the illustrative context of the celebrated knapsack problem. Leveraging the notion of fitness landscape analysis, our algorithm-specific approach incorporates neighbourhood structures induced by metaheuristic perturbation operators. Employing a random forest model, we conduct a comprehensive empirical analysis, contrasting algorithm-specific and problem-specific meta-learning. Two renowned metaheuristic search paradigms are considered—that of simulated annealing and that of a genetic algorithm—each with various hyperparameter and perturbation operator configurations. The numerical results provide insight into the cost-benefit trade-off between problem-specific meta-learning and algorithm-specific meta-learning. It is found that algorithm-specific information yields superior meta-learning performance, but incurs a greater computational cost during meta-feature extraction.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

The Cost-Benefit Trade-Off Between Problem-Specific and Algorithm-Specific Meta-learning for the Knapsack Problem

  • Nathan J. van der Westhuyzen,
  • Jan H. van Vuuren

摘要

In this paper, we consider the meta-learning problem of metaheuristic optimisation performance prediction as a foundation underlying the task of algorithm selection for solving optimisation problems. The relative effectiveness of a problem-specific versus an algorithm-specific meta-learning approach is ascertained in the illustrative context of the celebrated knapsack problem. Leveraging the notion of fitness landscape analysis, our algorithm-specific approach incorporates neighbourhood structures induced by metaheuristic perturbation operators. Employing a random forest model, we conduct a comprehensive empirical analysis, contrasting algorithm-specific and problem-specific meta-learning. Two renowned metaheuristic search paradigms are considered—that of simulated annealing and that of a genetic algorithm—each with various hyperparameter and perturbation operator configurations. The numerical results provide insight into the cost-benefit trade-off between problem-specific meta-learning and algorithm-specific meta-learning. It is found that algorithm-specific information yields superior meta-learning performance, but incurs a greater computational cost during meta-feature extraction.