论文标题
使用统计测试比较群和进化计算算法的最新趋势:实用准则和批判性审查
Recent Trends in the Use of Statistical Tests for Comparing Swarm and Evolutionary Computing Algorithms: Practical Guidelines and a Critical Review
论文作者
论文摘要
进化和群智能算法设计的一个关键方面是研究其性能。统计比较也是至关重要的部分,可以得出可靠的结论。在本文中,我们收集并研究了从不同角度采取的方法来总结这些统计检验的假设,得出的结论以及遵循的步骤以正确执行它们。在本文中,我们对统计分析提案的当前趋势进行了调查,以比较计算智能算法,并包括对这些测试的统计背景的描述。我们说明了在竞争的上下文中使用最常见的测试对IEEE进化计算大会(CEC)2017的单目标实际参数优化,并描述了使用每种测试的主要优点和缺点,并提出了一些有关其使用的建议。
A key aspect of the design of evolutionary and swarm intelligence algorithms is studying their performance. Statistical comparisons are also a crucial part which allows for reliable conclusions to be drawn. In the present paper we gather and examine the approaches taken from different perspectives to summarise the assumptions made by these statistical tests, the conclusions reached and the steps followed to perform them correctly. In this paper, we conduct a survey on the current trends of the proposals of statistical analyses for the comparison of algorithms of computational intelligence and include a description of the statistical background of these tests. We illustrate the use of the most common tests in the context of the Competition on single-objective real parameter optimisation of the IEEE Congress on Evolutionary Computation (CEC) 2017 and describe the main advantages and drawbacks of the use of each kind of test and put forward some recommendations concerning their use.