论文标题
多种方式对情绪识别的影响：调查3D面部标志，行动单元和生理数据
Impact of multiple modalities on emotion recognition: investigation into 3d facial landmarks, action units, and physiological data
论文作者
论文摘要
为了充分了解人类情感的复杂性，来自不同方式的多个物理特征的整合可能是有利的。考虑到这一点，我们对3D面部数据，动作单位和生理数据进行了分析，因为它们与它们对情绪识别的影响有关。我们独立分析每种方式，以及每种方式的融合，以识别人类的情绪。该分析包括哪些功能对于特定情绪最为重要（例如快乐）。我们的分析表明，对于表达/情感识别，3D面部地标和生理数据都令人鼓舞。另一方面，尽管动作单元与其他方式融合时会积极影响情绪识别，但结果表明，很难以单峰方式检测情绪。
To fully understand the complexities of human emotion, the integration of multiple physical features from different modalities can be advantageous. Considering this, we present an analysis of 3D facial data, action units, and physiological data as it relates to their impact on emotion recognition. We analyze each modality independently, as well as the fusion of each for recognizing human emotion. This analysis includes which features are most important for specific emotions (e.g. happy). Our analysis indicates that both 3D facial landmarks and physiological data are encouraging for expression/emotion recognition. On the other hand, while action units can positively impact emotion recognition when fused with other modalities, the results suggest it is difficult to detect emotion using them in a unimodal fashion.
