论文标题
主题控制的摘要：主题感知评估和变压器方法
Topic-Controllable Summarization: Topic-Aware Evaluation and Transformer Methods
论文作者
论文摘要
可控制的摘要是一个具有广泛潜在应用的新兴研究领域。但是，现有方法受到重大局限性。例如，与较新的基于变压器的体系结构相比，大多数现有的基于经常性架构的现有方法可能会大大限制其性能，同时它们还需要对模型的架构进行修改以控制主题。同时，目前尚无专门为主题控制的摘要设计的既定评估度量。这项工作提出了一种新的面向主题的评估措施，以根据生成的摘要与所需主题之间的主题亲和力自动评估生成的摘要。通过适当设计的人类评估证明了拟议措施的可靠性。此外，我们适应主题嵌入以与强大的变压器体系结构一起使用，并提出了一种新颖有效的方法来通过控制令牌指导摘要生成。实验结果表明，与更复杂的基于嵌入的方法相比，对照令牌可以实现更好的性能，同时也更快。
Topic-controllable summarization is an emerging research area with a wide range of potential applications. However, existing approaches suffer from significant limitations. For example, the majority of existing methods built upon recurrent architectures, which can significantly limit their performance compared to more recent Transformer-based architectures, while they also require modifications to the model's architecture for controlling the topic. At the same time, there is currently no established evaluation metric designed specifically for topic-controllable summarization. This work proposes a new topic-oriented evaluation measure to automatically evaluate the generated summaries based on the topic affinity between the generated summary and the desired topic. The reliability of the proposed measure is demonstrated through appropriately designed human evaluation. In addition, we adapt topic embeddings to work with powerful Transformer architectures and propose a novel and efficient approach for guiding the summary generation through control tokens. Experimental results reveal that control tokens can achieve better performance compared to more complicated embedding-based approaches while also being significantly faster.
