论文标题

捕获更丰富的信息 - 建立间隔价值调查响应模式的有效性

Capturing Richer Information -- On Establishing the Validity of an Interval-Valued Survey Response Mode

论文作者

Ellerby, Zack, Wagner, Christian, Broomell, Stephen

论文摘要

获得准确且信息性的定量调查响应对于广泛的领域至关重要。传统和无处不在的响应格式(例如李克特和视觉模拟量表)需要将响应凝结成离散点值 - 但有时一系列选项可以更好地代表正确的答案。在本文中,我们提出了一个有效的间隔值响应模式,从而通过沿连续尺度标记椭圆形成响应。我们讨论了它的潜力,以捕获和量化使用常规方法丢失的有价值信息,同时保留高度的响应效率。响应间隔捕获的信息可能代表可能的响应范围 - 即连接集,例如三到六个之间的实数。另外,它可能反映出关于独特响应的不确定性 - 即脱节集合,例如置信区间。然后,我们报告了一项验证研究,利用我们最近引入的开源软件(DECSYS)来探讨间隔值的调查响应如何反映了对多种情况下影响间隔宽度的几种因素的实验操作。结果始终表明受访者有效地使用了间隔宽度,主观参与者的反馈也是积极的。我们将其表示为间隔值响应捕获的功效和价值的最初经验证据。有趣的是,我们的结果还可以洞悉受访者对上述不同类型的间隔的推理 - 我们复制了代表认知不确定性(即脱节集)的人的过度自信的趋势,但是找到代表固有范围的间隔(即结合集合)是良好的校准。

Obtaining quantitative survey responses that are both accurate and informative is crucial to a wide range of fields. Traditional and ubiquitous response formats such as Likert and Visual Analogue Scales require condensation of responses into discrete point values - but sometimes a range of options may better represent the correct answer. In this paper, we propose an efficient interval-valued response mode, whereby responses are made by marking an ellipse along a continuous scale. We discuss its potential to capture and quantify valuable information that would be lost using conventional approaches, while preserving a high degree of response-efficiency. The information captured by the response interval may represent a possible response range - i.e., a conjunctive set, such as the real numbers between three and six. Alternatively, it may reflect uncertainty in respect to a distinct response - i.e., a disjunctive set, such as a confidence interval. We then report a validation study, utilizing our recently introduced open-source software (DECSYS) to explore how interval-valued survey responses reflect experimental manipulations of several factors hypothesised to influence interval width, across multiple contexts. Results consistently indicate that respondents used interval widths effectively, and subjective participant feedback was also positive. We present this as initial empirical evidence for the efficacy and value of interval-valued response capture. Interestingly, our results also provide insight into respondents' reasoning about the different aforementioned types of intervals - we replicate a tendency towards overconfidence for those representing epistemic uncertainty (i.e., disjunctive sets), but find intervals representing inherent range (i.e., conjunctive sets) to be well-calibrated.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源