论文标题
神经网络鲁棒性分析的领域理论框架
A Domain-Theoretic Framework for Robustness Analysis of Neural Networks
论文作者
论文摘要
提出了一个领域理论框架,以验证神经网络的鲁棒性分析。首先,分析了一般网络类别的全球鲁棒性。然后,使用Edalat的域理论L衍生物与Clarke的广义梯度相吻合的事实,该框架被扩展为攻击性不足的局部鲁棒性分析。所提出的框架是设计构造正确的算法的理想选择。通过开发经过验证的算法来估计前馈回归器常数的验证算法来体现这种说法。该算法的完整性在可区分的网络以及一般位置Relu网络上证明了。可计算结果是在有效给定域的框架内获得的。使用所提出的域模型,可以统一分析可区分和非差异网络。经过验证的算法是使用任意推测间隔算术实现的,并提出了某些实验的结果。该软件实现也是真正验证的,因为它也处理浮点错误。
A domain-theoretic framework is presented for validated robustness analysis of neural networks. First, global robustness of a general class of networks is analyzed. Then, using the fact that Edalat's domain-theoretic L-derivative coincides with Clarke's generalized gradient, the framework is extended for attack-agnostic local robustness analysis. The proposed framework is ideal for designing algorithms which are correct by construction. This claim is exemplified by developing a validated algorithm for estimation of Lipschitz constant of feedforward regressors. The completeness of the algorithm is proved over differentiable networks, and also over general position ReLU networks. Computability results are obtained within the framework of effectively given domains. Using the proposed domain model, differentiable and non-differentiable networks can be analyzed uniformly. The validated algorithm is implemented using arbitrary-precision interval arithmetic, and the results of some experiments are presented. The software implementation is truly validated, as it handles floating-point errors as well.