论文标题
通过解决方案预测和机器学习来增强蚂蚁菌落优化
Boosting Ant Colony Optimization via Solution Prediction and Machine Learning
论文作者
论文摘要
本文介绍了增强的元元素(ML-ACO),该元数据结合了机器学习(ML)和蚂蚁菌落优化(ACO),以解决组合优化问题。为了说明ML-ACO算法的基本机制,我们首先描述了测试问题,即定向问题。在此问题中,目的是找到一条在时间预算内访问图表中的顶点子集的路线,以最大程度地提高收集的分数。在我们的ML-ACO算法的第一阶段中,使用一组已知最佳解决方案的小问题实例对ML模型进行训练。具体而言,分类模型用于使用特定问题的特征和统计措施将边缘分类为最佳路线的一部分。然后,使用训练的模型来预测测试问题实例图中的边缘属于相应的最佳路由的概率。在第二阶段,我们将预测的概率纳入算法的ACO分量中,即将概率值作为启发式权重或温暖启动信息素基质。在这里,概率值偏向采样倾向于在构建可行路线时偏爱那些预测的高质量边缘。我们已经测试了多个分类模型,包括图形神经网络,逻辑回归和支持向量机,实验结果表明,我们的解决方案预测方法始终提高ACO的性能。此外,我们从经验上表明,我们的小型合成实例训练的ML模型可以很好地推广到大型合成和现实世界实例。我们将ML与元海拔脉动整合的方法是通用的,可以应用于广泛的优化问题。
This paper introduces an enhanced meta-heuristic (ML-ACO) that combines machine learning (ML) and ant colony optimization (ACO) to solve combinatorial optimization problems. To illustrate the underlying mechanism of our ML-ACO algorithm, we start by describing a test problem, the orienteering problem. In this problem, the objective is to find a route that visits a subset of vertices in a graph within a time budget to maximize the collected score. In the first phase of our ML-ACO algorithm, an ML model is trained using a set of small problem instances where the optimal solution is known. Specifically, classification models are used to classify an edge as being part of the optimal route, or not, using problem-specific features and statistical measures. The trained model is then used to predict the probability that an edge in the graph of a test problem instance belongs to the corresponding optimal route. In the second phase, we incorporate the predicted probabilities into the ACO component of our algorithm, i.e., using the probability values as heuristic weights or to warm start the pheromone matrix. Here, the probability values bias sampling towards favoring those predicted high-quality edges when constructing feasible routes. We have tested multiple classification models including graph neural networks, logistic regression and support vector machines, and the experimental results show that our solution prediction approach consistently boosts the performance of ACO. Further, we empirically show that our ML model trained on small synthetic instances generalizes well to large synthetic and real-world instances. Our approach integrating ML with a meta-heuristic is generic and can be applied to a wide range of optimization problems.