论文标题

具有深层神经网络的文本中数学定义的自动发现

Automated Discovery of Mathematical Definitions in Text with Deep Neural Networks

论文作者

Vanetik, Natalia, Litvak, Marina, Shevchuk, Sergey, Reznik, Lior

论文摘要

自动定义从文本中提取是一项重要的任务,它在几个自然语言处理领域中具有许多应用,例如摘要,科学文本分析,自动分类学生成,本体论生成,概念识别和问题答案。对于单个句子中包含的定义,可以将此问题视为将句子的二进制分类视为定义和非定义。在本文中,我们专注于自动检测数学文本中的单句定义,这些定义很难与周围的文本分开。我们尝试了几种数据表示,其中包括句子句法结构和单词嵌入,并应用深度学习方法,例如卷积神经网络(CNN)和长期短期存储网络(LSTM),以识别数学定义。当应用于语法增强的输入表示上时,我们的实验证明了CNN及其与LSTM的优势。我们还提出了一个新数据集,用于从数学文本中提取定义。我们证明该数据集有利于培训旨在提取数学定义的监督模型。我们对不同领域的实验表明,数学定义需要特殊治疗,并且使用跨域学习对该任务效率低下。

Automatic definition extraction from texts is an important task that has numerous applications in several natural language processing fields such as summarization, analysis of scientific texts, automatic taxonomy generation, ontology generation, concept identification, and question answering. For definitions that are contained within a single sentence, this problem can be viewed as a binary classification of sentences into definitions and non-definitions. In this paper, we focus on automatic detection of one-sentence definitions in mathematical texts, which are difficult to separate from surrounding text. We experiment with several data representations, which include sentence syntactic structure and word embeddings, and apply deep learning methods such as the Convolutional Neural Network (CNN) and the Long Short-Term Memory network (LSTM), in order to identify mathematical definitions. Our experiments demonstrate the superiority of CNN and its combination with LSTM, when applied on the syntactically-enriched input representation. We also present a new dataset for definition extraction from mathematical texts. We demonstrate that this dataset is beneficial for training supervised models aimed at extraction of mathematical definitions. Our experiments with different domains demonstrate that mathematical definitions require special treatment, and that using cross-domain learning is inefficient for that task.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源