论文标题
二阶对称非阴性潜在因子分析
Second-order Symmetric Non-negative Latent Factor Analysis
论文作者
论文摘要
大规模无向网络的精确表示是理解大型实体集合中关系的基础。无向网络表示任务可以通过对称非负潜在因素(SNLF)模型有效地解决,其目标显然是非键。但是,现有的SNLF模型通常采用无法很好地处理非凸目标的一阶优化器,从而导致不准确的表示结果。另一方面,高阶学习算法有望取得突破,但是由于直接操纵Hessian Matrix,它们的计算效率受到了极大的限制,Hessian Matrix在非方向的网络表示任务中可能是巨大的。为了解决这个问题,本研究提议将有效的二阶方法纳入SNLF,从而建立了二阶对称非负因素分析模型,用于未方向的网络,具有两个折叠的想法:a)将映射策略纳入SNLF模型中,以形成不限制的模型,以及b)训练未经限制的模型,以获得专门设计的二级方法,以适当地构成二级方法。经验研究表明,提出的模型以负担得起的计算负担的表现精度优于最先进的模型。
Precise representation of large-scale undirected network is the basis for understanding relations within a massive entity set. The undirected network representation task can be efficiently addressed by a symmetry non-negative latent factor (SNLF) model, whose objective is clearly non-convex. However, existing SNLF models commonly adopt a first-order optimizer that cannot well handle the non-convex objective, thereby resulting in inaccurate representation results. On the other hand, higher-order learning algorithms are expected to make a breakthrough, but their computation efficiency are greatly limited due to the direct manipulation of the Hessian matrix, which can be huge in undirected network representation tasks. Aiming at addressing this issue, this study proposes to incorporate an efficient second-order method into SNLF, thereby establishing a second-order symmetric non-negative latent factor analysis model for undirected network with two-fold ideas: a) incorporating a mapping strategy into SNLF model to form an unconstrained model, and b) training the unconstrained model with a specially designed second order method to acquire a proper second-order step efficiently. Empirical studies indicate that proposed model outperforms state-of-the-art models in representation accuracy with affordable computational burden.