论文标题
结合学习和优化用于超探测计算
Combining Learning and Optimization for Transprecision Computing
论文作者
论文摘要
全球IT基础设施的需求不断增长,强调了减少功耗的需求,这是通过以精确性为代价来提高能源效率的所谓的推出计算。例如,减少某些浮点操作的位数会导致更高的效率,但也导致计算精度的非线性降低。根据应用的不同,可以容忍小错误,从而可以微调计算的精度。找到有关误差绑定的所有变量的最佳精度是一项复杂的任务,它通过启发式方法在文献中解决。在本文中,我们通过结合数学编程(MP)模型和机器学习(ML)模型(按照经验模型学习方法学)进行了首次尝试解决问题的尝试。 ML模型了解变量精度与输出误差之间的关系;然后将这些信息嵌入到最小化位数的MP中。然后添加额外的改进阶段以提高溶液的质量。实验结果表明,与最先进的速度相比,溶液质量的平均加速度为6.5 \%。此外,在能够混合精确算术(Pulpissimo)的硬件平台上进行的实验显示了该方法的好处,与固定精确性相比,能源节省约为40 \%。
The growing demands of the worldwide IT infrastructure stress the need for reduced power consumption, which is addressed in so-called transprecision computing by improving energy efficiency at the expense of precision. For example, reducing the number of bits for some floating-point operations leads to higher efficiency, but also to a non-linear decrease of the computation accuracy. Depending on the application, small errors can be tolerated, thus allowing to fine-tune the precision of the computation. Finding the optimal precision for all variables in respect of an error bound is a complex task, which is tackled in the literature via heuristics. In this paper, we report on a first attempt to address the problem by combining a Mathematical Programming (MP) model and a Machine Learning (ML) model, following the Empirical Model Learning methodology. The ML model learns the relation between variables precision and the output error; this information is then embedded in the MP focused on minimizing the number of bits. An additional refinement phase is then added to improve the quality of the solution. The experimental results demonstrate an average speedup of 6.5\% and a 3\% increase in solution quality compared to the state-of-the-art. In addition, experiments on a hardware platform capable of mixed-precision arithmetic (PULPissimo) show the benefits of the proposed approach, with energy savings of around 40\% compared to fixed-precision.