论文标题

面具和披肩:使用蒙版语言模型自动开放披肩问题生成

Mask and Cloze: Automatic Open Cloze Question Generation using a Masked Language Model

论文作者

Matsumori, Shoya, Okuoka, Kohei, Shibata, Ryoichi, Inoue, Minami, Fukuchi, Yosuke, Imai, Michita

论文摘要

开放的披肩问题吸引了衡量能力和促进L2英语学习者学习的关注。尽管有好处,但开放的披肩测试仅在教育方面偶尔引入,这主要是因为教师手动创建问题是沉重的。与更常用的多项选择问题(MCQ)不同,开放的披肩问题是自由形式的,因此教师必须确保只有一个基础真相答案,并且在空白中不会接受其他单词。为了减轻这种负担,我们开发了一种自动开放式披肩问题生成器的Clozer。在这项工作中,我们通过对1,600个答案的定量实验评估了Clozer,并从统计上表明它可以成功地产生仅接受地面真相答案的开放式披肩问题。与人类生成的问题进行了比较实验还表明,克利泽尔可以比普通的非本地英语老师更好地产生OCQ。此外,我们在当地一所高中进行了一项实地研究,以阐明引入Clozer时的好处和障碍。结果表明,尽管学生发现该应用程序对他们的语言学习有用。最后,根据我们的发现,我们提出了一些设计改进。

Open cloze questions have been attracting attention for both measuring the ability and facilitating the learning of L2 English learners. In spite of its benefits, the open cloze test has been introduced only sporadically on the educational front, largely because it is burdensome for teachers to manually create the questions. Unlike the more commonly used multiple choice questions (MCQ), open cloze questions are in free form and thus teachers have to ensure that only a ground truth answer and no additional words will be accepted in the blank. To help ease this burden, we developed CLOZER, an automatic open cloze question generator. In this work, we evaluate CLOZER through quantitative experiments on 1,600 answers and show statistically that it can successfully generate open cloze questions that only accept the ground truth answer. A comparative experiment with human-generated questions also reveals that CLOZER can generate OCQs better than the average non-native English teacher. Additionally, we conduct a field study at a local high school to clarify the benefits and hurdles when introducing CLOZER. The results demonstrate that while students found the application useful for their language learning. Finally, on the basis of our findings, we proposed several design improvements.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源