论文标题
当前的解码策略是否能够面临视觉对话的挑战?
Are Current Decoding Strategies Capable of Facing the Challenges of Visual Dialogue?
论文作者
论文摘要
解码策略在自然语言生成系统中起着至关重要的作用。它们通常是在仅开放式文本任务中设计和评估的,尚不清楚不同的策略如何应对以目标为导向的多模式系统所面临的众多挑战(例如接地和信息性)。为了回答这个问题,我们比较了视觉对话参考游戏中各种不同的解码策略和超参数配置。尽管他们都没有成功平衡词汇丰富性,任务的准确性和视觉接地,但我们的深入分析使我们能够强调每个解码策略的优点和缺点。我们认为,我们的发现和建议可能是设计更有效的解码算法的起点,以应对视觉对话任务的挑战。
Decoding strategies play a crucial role in natural language generation systems. They are usually designed and evaluated in open-ended text-only tasks, and it is not clear how different strategies handle the numerous challenges that goal-oriented multimodal systems face (such as grounding and informativeness). To answer this question, we compare a wide variety of different decoding strategies and hyper-parameter configurations in a Visual Dialogue referential game. Although none of them successfully balance lexical richness, accuracy in the task, and visual grounding, our in-depth analysis allows us to highlight the strengths and weaknesses of each decoding strategy. We believe our findings and suggestions may serve as a starting point for designing more effective decoding algorithms that handle the challenges of Visual Dialogue tasks.