论文标题
使用情感嵌入来转移情感,语言和注释格式之间的知识
Using Emotion Embeddings to Transfer Knowledge Between Emotions, Languages, and Annotation Formats
论文作者
论文摘要
随着越来越多的学科将情绪融入他们的理论和应用,对情感推断的需求继续使人们多样化。这些需求包括推断不同的情绪类型,处理多种语言以及不同的注释格式。不同配置之间的共同模型将使知识共享和培训成本的降低,并简化了在新型环境中部署情绪识别模型的过程。在这项工作中,我们研究了如何通过利用多语言模型和Demux来构建可以在这些不同配置之间过渡的单个模型,该模型和Demux是一个基于变压器的模型,其输入包括感兴趣的情绪,使我们能够动态地改变模型预测的情绪。 Demux还会产生情感嵌入,并且对它们进行操作使我们能够通过汇总每个群集的嵌入来过渡到情绪群。我们表明,demux可以同时以零声的方式将知识转移到一种新语言,新颖的注释格式和看不见的情绪中。代码可在https://github.com/gchochla/demux-memo上找到。
The need for emotional inference from text continues to diversify as more and more disciplines integrate emotions into their theories and applications. These needs include inferring different emotion types, handling multiple languages, and different annotation formats. A shared model between different configurations would enable the sharing of knowledge and a decrease in training costs, and would simplify the process of deploying emotion recognition models in novel environments. In this work, we study how we can build a single model that can transition between these different configurations by leveraging multilingual models and Demux, a transformer-based model whose input includes the emotions of interest, enabling us to dynamically change the emotions predicted by the model. Demux also produces emotion embeddings, and performing operations on them allows us to transition to clusters of emotions by pooling the embeddings of each cluster. We show that Demux can simultaneously transfer knowledge in a zero-shot manner to a new language, to a novel annotation format and to unseen emotions. Code is available at https://github.com/gchochla/Demux-MEmo .