论文标题

部分可观测时空混沌系统的无模型预测

GRETEL: A unified framework for Graph Counterfactual Explanation Evaluation

论文作者

Prado-Romero, Mario Alfonso, Stilo, Giovanni

论文摘要

机器学习(ML)系统是现代工具的一个建筑物,它影响了我们在几个应用领域的日常生活。由于其黑盒性质,这些系统在应用程序域(例如健康,金融)中几乎不采用,其中理解决策过程至关重要。开发了解释方法来解释ML模型如何针对给定情况/实例做出特定决定。图反事实说明(GCE)是图学习域中采用的解释技术之一。现有的反事实解释的现有作品主要在问题定义,应用程序域,测试数据和评估指标上以及大多数现有作品都与文献中存在的其他反事实解释技术进行详尽的比较。我们提出了Gretel,这是一个在多种设置中开发和测试GCE方法的统一框架。 Gretel是一个高度可扩展的评估框架,通过提供一组明确定义的机制来促进开放科学和评估可重复性,以易于整合和管理:真实和合成数据集,ML模型,最先进的解释技术和评估指标。为了介绍Gretel,我们显示了进行的实验,以将几个合成和真实数据集与几种现有的解释技术和基本ML模型进行整合和测试。

Machine Learning (ML) systems are a building part of the modern tools which impact our daily life in several application domains. Due to their black-box nature, those systems are hardly adopted in application domains (e.g. health, finance) where understanding the decision process is of paramount importance. Explanation methods were developed to explain how the ML model has taken a specific decision for a given case/instance. Graph Counterfactual Explanations (GCE) is one of the explanation techniques adopted in the Graph Learning domain. The existing works of Graph Counterfactual Explanations diverge mostly in the problem definition, application domain, test data, and evaluation metrics, and most existing works do not compare exhaustively against other counterfactual explanation techniques present in the literature. We present GRETEL, a unified framework to develop and test GCE methods in several settings. GRETEL is a highly extensible evaluation framework which promotes the Open Science and the evaluations reproducibility by providing a set of well-defined mechanisms to integrate and manage easily: both real and synthetic datasets, ML models, state-of-the-art explanation techniques, and evaluation measures. To present GRETEL, we show the experiments conducted to integrate and test several synthetic and real datasets with several existing explanation techniques and base ML models.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源