论文标题
多输出预测的深树份
Deep tree-ensembles for multi-output prediction
论文作者
论文摘要
最近,深层神经网络扩大了各个科学领域的最新时间,并为多个应用领域的长期存在问题提供了解决方案。然而,它们也遭受弱点的困扰,因为它们的最佳性能取决于大量训练数据和扩展参数的调整。作为对策,最近已经提出了一些深森林方法,作为有效和低规模的解决方案。尽管如此,这些方法只是将标签分类概率作为诱导特征,主要集中在传统的分类和回归任务上,而多输出预测的预测不足。此外,最近的工作表明,树的束缚具有很高的代表性,尤其是在结构化的输出预测中。在这个方向上,我们提出了一个新颖的深树征(DTE)模型,其中每一层都以基于树的形式的代表学习组件来丰富原始特征集。在本文中,我们专门关注两个结构化的输出预测任务,即多标签分类和多目标回归。我们使用多个基准数据集进行了实验,并且获得的结果证实,我们的方法为这两个任务中的最新方法提供了优越的结果。
Recently, deep neural networks have expanded the state-of-art in various scientific fields and provided solutions to long standing problems across multiple application domains. Nevertheless, they also suffer from weaknesses since their optimal performance depends on massive amounts of training data and the tuning of an extended number of parameters. As a countermeasure, some deep-forest methods have been recently proposed, as efficient and low-scale solutions. Despite that, these approaches simply employ label classification probabilities as induced features and primarily focus on traditional classification and regression tasks, leaving multi-output prediction under-explored. Moreover, recent work has demonstrated that tree-embeddings are highly representative, especially in structured output prediction. In this direction, we propose a novel deep tree-ensemble (DTE) model, where every layer enriches the original feature set with a representation learning component based on tree-embeddings. In this paper, we specifically focus on two structured output prediction tasks, namely multi-label classification and multi-target regression. We conducted experiments using multiple benchmark datasets and the obtained results confirm that our method provides superior results to state-of-the-art methods in both tasks.