论文标题
避免:双重序列预测和对抗性示例,以改善事实检查
DeSePtion: Dual Sequence Prediction and Adversarial Examples for Improved Fact-Checking
论文作者
论文摘要
对错误信息的关注越来越多,刺激了数据和系统的发展,以检测索赔的真实性以及检索权威证据。提取和验证(发烧)数据集为评估端到端事实检查提供了这样的资源,需要从维基百科中检索证据来验证真实性预测。我们表明,当前发烧系统容易受到事实检查的三类现实挑战 - 多个命题,时间推理,歧义性和词汇变化 - 并引入了具有这些主张类型的资源。然后,我们提出了一个系统,旨在使用多个指针网络进行文档选择并共同对证据句子和真实关系预测进行共同建模。我们发现,在处理这些攻击时,我们获得了发烧的最新结果,这主要是由于证据检索的改善。
The increased focus on misinformation has spurred development of data and systems for detecting the veracity of a claim as well as retrieving authoritative evidence. The Fact Extraction and VERification (FEVER) dataset provides such a resource for evaluating end-to-end fact-checking, requiring retrieval of evidence from Wikipedia to validate a veracity prediction. We show that current systems for FEVER are vulnerable to three categories of realistic challenges for fact-checking -- multiple propositions, temporal reasoning, and ambiguity and lexical variation -- and introduce a resource with these types of claims. Then we present a system designed to be resilient to these "attacks" using multiple pointer networks for document selection and jointly modeling a sequence of evidence sentences and veracity relation predictions. We find that in handling these attacks we obtain state-of-the-art results on FEVER, largely due to improved evidence retrieval.