论文标题
合作AI中的开放问题
Open Problems in Cooperative AI
论文作者
论文摘要
合作问题 - 在哪些代理商中寻求共同改善其福利的方法 - 无处不在和重要。可以在我们的日常工作中找到它们,例如在高速公路上开车,安排会议和合作(我们的全球挑战),例如和平,商业和大流行准备。可以说,人类的成功源于我们合作的能力。由于由人工智能提供支持的机器在我们的生活中发挥了更大的作用,因此为他们配备合作和促进合作所需的能力将很重要。 我们看到了一个人工智能领域的机会,可以将努力明确地集中在这类问题上,我们将其称为合作AI。这项研究的目的是研究合作问题的许多方面,并在AI中进行创新以解决这些问题。中心目标包括建造具有合作能力的机器代理,建立工具以促进(机器和/或人)代理人的人口合作,以及进行与合作问题有关的洞察力研究的AI研究。这项研究将正在进行的工作集成了多代理系统,游戏理论和社会选择,人机互动和对齐,自然语言处理以及社交工具和平台的构建。但是,合作AI不是这些现有领域的结合,而是对涉及这些领域和其他领域的特定对话的生产力的独立赌注。我们看到机会更明确地专注于合作问题,建立统一的理论和词汇,并与邻近社区合作(包括自然,社会和行为科学)建立桥梁。
Problems of cooperation--in which agents seek ways to jointly improve their welfare--are ubiquitous and important. They can be found at scales ranging from our daily routines--such as driving on highways, scheduling meetings, and working collaboratively--to our global challenges--such as peace, commerce, and pandemic preparedness. Arguably, the success of the human species is rooted in our ability to cooperate. Since machines powered by artificial intelligence are playing an ever greater role in our lives, it will be important to equip them with the capabilities necessary to cooperate and to foster cooperation. We see an opportunity for the field of artificial intelligence to explicitly focus effort on this class of problems, which we term Cooperative AI. The objective of this research would be to study the many aspects of the problems of cooperation and to innovate in AI to contribute to solving these problems. Central goals include building machine agents with the capabilities needed for cooperation, building tools to foster cooperation in populations of (machine and/or human) agents, and otherwise conducting AI research for insight relevant to problems of cooperation. This research integrates ongoing work on multi-agent systems, game theory and social choice, human-machine interaction and alignment, natural-language processing, and the construction of social tools and platforms. However, Cooperative AI is not the union of these existing areas, but rather an independent bet about the productivity of specific kinds of conversations that involve these and other areas. We see opportunity to more explicitly focus on the problem of cooperation, to construct unified theory and vocabulary, and to build bridges with adjacent communities working on cooperation, including in the natural, social, and behavioural sciences.