论文标题

具有情节记忆的智能代理商的建议

A Proposal for Intelligent Agents with Episodic Memory

论文作者

Murphy, David, Paula, Thomas S., Staehler, Wagston, Vacaro, Juliano, Paz, Gabriel, Marques, Guilherme, Oliveira, Bruna

论文摘要

将来,我们可以预期,一旦部署的人工智能代理人将被要求从他们的运营生活中不断学习。这样的代理人还需要与人类和其他代理人就经验的内容进行沟通,在经过学习的背景下,目的是在特定情况下解释他们的行为,或者只是与人类有关代理商所获得的经验更自然地与人类所获得的经验有关,而这些经验不一定与分配的任务相关。我们认为,为了支持这些目标,代理人将从情节记忆中受益。也就是说,一种记忆以一种方式来编码代理商的经验,使代理人可以重温体验,对其进行交流并利用其过去的经验,包括代理商自己的过去行动,以学习更有效的模型和政策。在这篇简短的论文中,我们提出了一种潜在的方法来为AI代理提供此类功能。我们借鉴了不断增长的工作体系,研究了哺乳动物中内侧颞叶(MTL)的功能和操作,以指导我们在由人工神经网络(ANN)组成的AI剂中添加情节记忆能力。基于此,我们强调了在内存组织中要考虑的重要方面,并提出了一种结合ANN和标准计算机科学技术的体系结构,以支持存储和检索情节记忆。尽管是最初的工作,但我们希望这篇简短的论文能够引发有关具有记忆力的智能代理商的讨论,或者至少在主题上提供了不同的观点。

In the future we can expect that artificial intelligent agents, once deployed, will be required to learn continually from their experience during their operational lifetime. Such agents will also need to communicate with humans and other agents regarding the content of their experience, in the context of passing along their learnings, for the purpose of explaining their actions in specific circumstances or simply to relate more naturally to humans concerning experiences the agent acquires that are not necessarily related to their assigned tasks. We argue that to support these goals, an agent would benefit from an episodic memory; that is, a memory that encodes the agent's experience in such a way that the agent can relive the experience, communicate about it and use its past experience, inclusive of the agents own past actions, to learn more effective models and policies. In this short paper, we propose one potential approach to provide an AI agent with such capabilities. We draw upon the ever-growing body of work examining the function and operation of the Medial Temporal Lobe (MTL) in mammals to guide us in adding an episodic memory capability to an AI agent composed of artificial neural networks (ANNs). Based on that, we highlight important aspects to be considered in the memory organization and we propose an architecture combining ANNs and standard Computer Science techniques for supporting storage and retrieval of episodic memories. Despite being initial work, we hope this short paper can spark discussions around the creation of intelligent agents with memory or, at least, provide a different point of view on the subject.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源