论文标题
无限循环中的人：揭示和解释人类互动循环失败的案例研究
The Human in the Infinite Loop: A Case Study on Revealing and Explaining Human-AI Interaction Loop Failures
论文作者
论文摘要
交互式AI系统越来越多地采用人类的战略。在设计此类系统时，这为HCI社区带来了新的挑战。我们在与行业合作伙伴的案例研究中揭示和调查了其中一些挑战，并开发了一种原型的人类在循环系统系统中，用于偏好引入的3D模型处理。两位3D艺术家在日常工作中使用了3个月。我们发现，人类环路通常不会收敛于令人满意的结果，并设计了实验室研究（n = 20）以进一步研究。我们通过人类判断的理论分析了交互数据和用户反馈，以通过两个关键见解来解释所观察到的人类在环上的失败：1）使用优先选择的优化缺乏应对不一致和矛盾的人类判断的机制； 2）机器结果反过来又通过启发式偏见和损失来影响未来的用户输入。为了减轻这些问题，我们提出了描述性UI设计指南。我们的案例研究提请人们注意在设计人类循环系统时需要考虑的人类环路中的具有挑战性和实际相关的缺陷。
Interactive AI systems increasingly employ a human-in-the-loop strategy. This creates new challenges for the HCI community when designing such systems. We reveal and investigate some of these challenges in a case study with an industry partner, and developed a prototype human-in-the-loop system for preference-guided 3D model processing. Two 3D artists used it in their daily work for 3 months. We found that the human-AI loop often did not converge towards a satisfactory result and designed a lab study (N=20) to investigate this further. We analyze interaction data and user feedback through the lens of theories of human judgment to explain the observed human-in-the-loop failures with two key insights: 1) optimization using preferential choices lacks mechanisms to deal with inconsistent and contradictory human judgments; 2) machine outcomes, in turn, influence future user inputs via heuristic biases and loss aversion. To mitigate these problems, we propose descriptive UI design guidelines. Our case study draws attention to challenging and practically relevant imperfections in human-AI loops that need to be considered when designing human-in-the-loop systems.
