论文标题
关于人工智能的安全评估
On Safety Assessment of Artificial Intelligence
论文作者
论文摘要
在本文中，我们讨论了使用人工智能（AI）的系统如何进行安全评估。如果AI用于安全性相关应用程序，这是相关的。我们表明，更深入地研究AI模型，许多人工智能模型，尤其是机器学习都是统计模型。然后，安全评估将集中在AI中使用的模型上，除了正常的评估程序。相关安全完整性水平的危险随机故障预算的一部分需要用于AI系统的概率错误行为。我们以一个简单的例子来证明我们的想法，并提出了一项研究挑战，这对于在安全相关系统中使用AI可能是决定性的。
In this paper we discuss how systems with Artificial Intelligence (AI) can undergo safety assessment. This is relevant, if AI is used in safety related applications. Taking a deeper look into AI models, we show, that many models of artificial intelligence, in particular machine learning, are statistical models. Safety assessment would then have t o concentrate on the model that is used in AI, besides the normal assessment procedure. Part of the budget of dangerous random failures for the relevant safety integrity level needs to be used for the probabilistic faulty behavior of the AI system. We demonstrate our thoughts with a simple example and propose a research challenge that may be decisive for the use of AI in safety related systems.
