论文标题
与课程学习的图形神经网络不平衡节点分类
Graph Neural Network with Curriculum Learning for Imbalanced Node Classification
论文作者
论文摘要
图形神经网络(GNN)是一种用于基于图形的学习任务(例如节点分类)的新兴技术。在这项工作中,我们揭示了GNN对节点标签不平衡的脆弱性。不平衡分类的传统解决方案(例如重采样)在节点分类中无效,而无需考虑图形结构。更糟糕的是,由于缺乏足够的先验知识,它们甚至可能带来过度拟合或不足的结果。为了解决这些问题,我们提出了一个新型的图形神经网络框架,其中包括两个模块组成的课程学习(GNN-CL)。一方面,我们希望通过基于平滑度和同质性的基于图形的过采样来获取某些可靠的插值节点和边缘。对于另一个,我们将图形分类损失和度量学习损失结合在一起,该损失调整了特征空间中与少数族裔类别相关的不同节点之间的距离。受课程学习的启发,我们在训练过程中动态调整了不同模块的权重,以实现更好的概括和歧视能力。提出的框架通过多个广泛使用的图形数据集进行评估,这表明我们所提出的模型始终优于现有的最新方法。
Graph Neural Network (GNN) is an emerging technique for graph-based learning tasks such as node classification. In this work, we reveal the vulnerability of GNN to the imbalance of node labels. Traditional solutions for imbalanced classification (e.g. resampling) are ineffective in node classification without considering the graph structure. Worse still, they may even bring overfitting or underfitting results due to lack of sufficient prior knowledge. To solve these problems, we propose a novel graph neural network framework with curriculum learning (GNN-CL) consisting of two modules. For one thing, we hope to acquire certain reliable interpolation nodes and edges through the novel graph-based oversampling based on smoothness and homophily. For another, we combine graph classification loss and metric learning loss which adjust the distance between different nodes associated with minority class in feature space. Inspired by curriculum learning, we dynamically adjust the weights of different modules during training process to achieve better ability of generalization and discrimination. The proposed framework is evaluated via several widely used graph datasets, showing that our proposed model consistently outperforms the existing state-of-the-art methods.