论文标题
对预测结果作为人类决策的解释的经验评估
An Empirical Evaluation of Predicted Outcomes as Explanations in Human-AI Decision-Making
论文作者
论文摘要
在这项工作中,我们根据预测的结果在存在的存在下凭经验检查了人类AI决策。这种类型的解释为人类决策者提供了预期的推理时替代方案的预期后果,在推理时间,通常以特定问题的单位(例如,以美元的美元利润)来衡量预测的结果。我们在点对点贷款的背景下进行了一项试点研究,以评估提供预测结果作为外行研究参与者的解释的影响。我们的初步发现表明,与没有提供基于解释或功能解释的情况相比,人们对AI建议的依赖增加,尤其是在AI建议不正确的情况下。这导致了将正确的AI建议与不正确的AI建议区分开的能力,这最终会以负面的方式影响决策质量。
In this work, we empirically examine human-AI decision-making in the presence of explanations based on predicted outcomes. This type of explanation provides a human decision-maker with expected consequences for each decision alternative at inference time - where the predicted outcomes are typically measured in a problem-specific unit (e.g., profit in U.S. dollars). We conducted a pilot study in the context of peer-to-peer lending to assess the effects of providing predicted outcomes as explanations to lay study participants. Our preliminary findings suggest that people's reliance on AI recommendations increases compared to cases where no explanation or feature-based explanations are provided, especially when the AI recommendations are incorrect. This results in a hampered ability to distinguish correct from incorrect AI recommendations, which can ultimately affect decision quality in a negative way.