论文标题
轻巧的多目标异步异步高参数优化器
A Light-Weight Multi-Objective Asynchronous Hyper-Parameter Optimizer
论文作者
论文摘要
我们描述了一个轻巧但性能的系统,用于高参数优化,该系统近似可最大程度地减少通过使用目标优先级标量标量的多重性能目标获得的总体标量成本函数。它还支持权衡模式,目标是通过与用户互动来找到目标之间的适当权衡。我们专注于在数十个超参数的顺序上,每个方案都具有各种属性,例如一系列连续值或有限的值列表,以及是否应以线性或对数刻度对其进行处理。该系统支持多个异步模拟,并且对模拟散乱者和失败具有鲁棒性。
We describe a light-weight yet performant system for hyper-parameter optimization that approximately minimizes an overall scalar cost function that is obtained by combining multiple performance objectives using a target-priority-limit scalarizer. It also supports a trade-off mode, where the goal is to find an appropriate trade-off among objectives by interacting with the user. We focus on the common scenario where there are on the order of tens of hyper-parameters, each with various attributes such as a range of continuous values, or a finite list of values, and whether it should be treated on a linear or logarithmic scale. The system supports multiple asynchronous simulations and is robust to simulation stragglers and failures.