论文标题

盲人训练:平衡准确性和鲁棒性

Blind Adversarial Training: Balance Accuracy and Robustness

论文作者

Xie, Haidong, Xiang, Xueshuang, Liu, Naijin, Dong, Bin

论文摘要

对抗性训练(AT)旨在通过混合干净的数据和对抗性示例(AES)来提高深度学习模型的鲁棒性。大多数现有的方法都可以分为受限制和不受限制的方法。受到限制,需要规定的统一预算来限制培训期间AE扰动的幅度,得到的结果显示出对预算的高敏感性。另一方面,不受限制地使用无约束的AE,导致使用位于决策边界以外的AE;这些高估的AE大大降低了清洁数据的准确性。这些局限性意味着,在面对具有不同优势的攻击时,现有的AT方法很难以高精度和稳健性获得全面的健壮模型。考虑到这个问题,本文提出了一本名为“盲人对抗训练”(BAT)的小说,以更好地平衡准确性和鲁棒性。这种方法的主要思想是使用截止尺度策略来适应不均匀的预算来修改培训中使用的AE,以确保AES的优势在合理的范围内动态位置,并最终改善了AT模型的整体鲁棒性。使用BAT用于训练分类模型获得的实验结果表明了该方法的竞争性能。

Adversarial training (AT) aims to improve the robustness of deep learning models by mixing clean data and adversarial examples (AEs). Most existing AT approaches can be grouped into restricted and unrestricted approaches. Restricted AT requires a prescribed uniform budget to constrain the magnitude of the AE perturbations during training, with the obtained results showing high sensitivity to the budget. On the other hand, unrestricted AT uses unconstrained AEs, resulting in the use of AEs located beyond the decision boundary; these overestimated AEs significantly lower the accuracy on clean data. These limitations mean that the existing AT approaches have difficulty in obtaining a comprehensively robust model with high accuracy and robustness when confronting attacks with varying strengths. Considering this problem, this paper proposes a novel AT approach named blind adversarial training (BAT) to better balance the accuracy and robustness. The main idea of this approach is to use a cutoff-scale strategy to adaptively estimate a nonuniform budget to modify the AEs used in the training, ensuring that the strengths of the AEs are dynamically located in a reasonable range and ultimately improving the overall robustness of the AT model. The experimental results obtained using BAT for training classification models on several benchmarks demonstrate the competitive performance of this method.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源