论文标题

重新访问图形神经网络

Revisiting Heterophily For Graph Neural Networks

论文作者

Luan, Sitao, Hua, Chenqing, Lu, Qincheng, Zhu, Jiaqi, Zhao, Mingde, Zhang, Shuyuan, Chang, Xiao-Wen, Precup, Doina

论文摘要

图形神经网络(GNN)通过基于关系电感偏置(同质假设)的图结构来扩展基本神经网络(NNS)。尽管通常认为GNN在现实世界任务中胜过NNS,但最近的工作已经确定了一组非平凡的数据集,在这些数据集中,它们的性能与NNS相比并不令人满意。异性恋已被认为是这种经验观察的主要原因,并提出了许多著作来解决它。在本文中,我们首先重新审视广泛使用的同质指标,并指出他们仅考虑图形标签的一致性是一个缺点。然后,我们从聚集后节点相似性的角度研究异质性,并定义了新的同质指标,与现有的指标相比,这可能是有利的。基于这项调查,我们证明,当地多元化操作可以有效解决一些异质性的有害病例。然后,我们提出了自适应通道混合(ACM),这是一个适应性利用聚合,多样化和身份通道节点的框架,以提取较丰富的局部信息,以解决多种节点杂质的情况。 ACM比用于异性图上的节点分类任务的常用单渠道框架更强大,并且在基线GNN层中易于实现。当对10个基准节点分类任务进行评估时,ACM增强的基线始终获得显着的性能增益,超过大多数任务的最新GNN,而不会产生重大的计算负担。

Graph Neural Networks (GNNs) extend basic Neural Networks (NNs) by using graph structures based on the relational inductive bias (homophily assumption). While GNNs have been commonly believed to outperform NNs in real-world tasks, recent work has identified a non-trivial set of datasets where their performance compared to NNs is not satisfactory. Heterophily has been considered the main cause of this empirical observation and numerous works have been put forward to address it. In this paper, we first revisit the widely used homophily metrics and point out that their consideration of only graph-label consistency is a shortcoming. Then, we study heterophily from the perspective of post-aggregation node similarity and define new homophily metrics, which are potentially advantageous compared to existing ones. Based on this investigation, we prove that some harmful cases of heterophily can be effectively addressed by local diversification operation. Then, we propose the Adaptive Channel Mixing (ACM), a framework to adaptively exploit aggregation, diversification and identity channels node-wisely to extract richer localized information for diverse node heterophily situations. ACM is more powerful than the commonly used uni-channel framework for node classification tasks on heterophilic graphs and is easy to be implemented in baseline GNN layers. When evaluated on 10 benchmark node classification tasks, ACM-augmented baselines consistently achieve significant performance gain, exceeding state-of-the-art GNNs on most tasks without incurring significant computational burden.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源