论文标题
理解注意力：在思想和机器上
Understanding Attention: In Minds and Machines
论文作者
论文摘要
注意是一个复杂而广泛的概念，在跨越人工智能，认知科学，心理学，神经科学和相关领域的多个学科进行了研究。尽管有关注意力的许多想法在这些领域之间并没有显着重叠，但对有限资源的自适应控制有一个共同的主题。在这项工作中，我们回顾了人工神经网络（ANN）中关注的概念和变体。我们还从与ANN平行的神经科学的角度讨论了关注的起源。与其在各个学科之间看似断开对话，我们建议将关注的概念框架上的思想扎根，以系统地分析注意力，并朝着AI和神经科学中的思想统一化。
Attention is a complex and broad concept, studied across multiple disciplines spanning artificial intelligence, cognitive science, psychology, neuroscience, and related fields. Although many of the ideas regarding attention do not significantly overlap among these fields, there is a common theme of adaptive control of limited resources. In this work, we review the concept and variants of attention in artificial neural networks (ANNs). We also discuss the origin of attention from the neuroscience point of view parallel to that of ANNs. Instead of having seemingly disconnected dialogues between varied disciplines, we suggest grounding the ideas on common conceptual frameworks for a systematic analysis of attention and towards possible unification of ideas in AI and Neuroscience.
