论文标题
“不，他们没有”：预先训练的语言模型中的对话响应动态
"No, they did not": Dialogue response dynamics in pre-trained language models
论文作者
论文摘要
语言能力的一个关键组成部分是能够确定话语的相关组成部分并适当地回复。在本文中，我们研究了预训练的语言模型中这种对话响应敏感性的程度，进行了一系列实验，特别着眼于涉及涉及含量和省略号现象的动力学敏感性。我们发现，模型对嵌入式子句的独特作用表现出明显的敏感性，以及对以先前话语的主要子句为目标的响应的一般偏好。但是，结果表明，捕获针对An-At-Insue与不发达内容的全部动态有关的混合趋势和趋势通常很弱。此外，模型在控制省略号的动力学方面显示出根本的局限性，而响应选择显示出明显的干扰，从表面因素大于原则性话语约束的影响。
A critical component of competence in language is being able to identify relevant components of an utterance and reply appropriately. In this paper we examine the extent of such dialogue response sensitivity in pre-trained language models, conducting a series of experiments with a particular focus on sensitivity to dynamics involving phenomena of at-issueness and ellipsis. We find that models show clear sensitivity to a distinctive role of embedded clauses, and a general preference for responses that target main clause content of prior utterances. However, the results indicate mixed and generally weak trends with respect to capturing the full range of dynamics involved in targeting at-issue versus not-at-issue content. Additionally, models show fundamental limitations in grasp of the dynamics governing ellipsis, and response selections show clear interference from superficial factors that outweigh the influence of principled discourse constraints.
