论文标题
研究软件众包的模式和任务多样性的影响
Study on Patterns and Effect of Task Diversity in Software Crowdsourcing
论文作者
论文摘要
上下文:软件众包的成功取决于稳定的任务供应和主动工作者池。现有分析表明,软件众包市场的平均任务失败率为15.7%。目标:这项研究的目的是凭经验研究软件众包平台中任务多样性的模式和效果,以提高软件众包的成功和效率。方法:我们提出了一个概念性任务多样性模型,并开发了一种测量和分析任务多样性的方法。更具体地说,这包括对相似的任务进行分组,根据他们的竞争水平对其进行分组,并确定区分这些水平之间的主要属性,然后研究任务多样性对众筹众筹工作和工人绩效的影响。实证研究是对领先的软件众包平台TopCoder的一年以上现实数据进行的。结果:我们确定货币奖和任务复杂性是不同竞争水平之间有区别的主要属性。基于这些主要属性,我们从工人的行为角度发现了三种任务多样性模式(配置):对奖品的反应,对奖品和复杂性的反应以及对奖品的反应过度。这项研究支持1)对奖品配置的响应,可以在平台中提供最高水平的任务密度和工人的可靠性; 2)响应奖品和复杂性配置会导致吸引高水平的值得信赖的工人; 3)对奖品配置的反应过度会导致最高的任务稳定性和平台中最低的失败率,而不是高度相似的任务。
Context: The success of software crowdsourcing depends on steady tasks supply and active worker pool. Existing analysis reveals an average task failure ratio of 15.7% in software crowdsourcing market. Goal: The objective of this study is to empirically investigate patterns and effect of task diversity in software crowdsourcing platform in order to improve the success and efficiency of software crowdsourcing. Method: We propose a conceptual task diversity model, and develop an approach to measuring and analyzing task diversity.More specifically, this includes grouping similar tasks, ranking them based on their competition level and identifying the dominant attributes that distinguish among these levels, and then studying the impact of task diversity on task success and worker performance in crowdsourcing platform. The empirical study is conducted on more than one year's real-world data from TopCoder, the leading software crowdsourcing platform. Results: We identified that monetary prize and task complexity are the dominant attributes that differentiate among different competition levels. Based on these dominant attributes, we found three task diversity patterns (configurations) from workers behavior perspective: responsive to prize, responsive to prize and complexity and over responsive to prize. This study supports that1) responsive to prize configuration provides highest level of task density and workers' reliability in a platform; 2) responsive to prize and complexity configuration leads to attracting high level of trustworthy workers; 3) over responsive to prize configuration results in highest task stability and the lowest failure ratio in the platform for not high similar tasks.