论文标题
用脑电图和深度学习建模认知负荷为自我监督的大脑率
Modeling cognitive load as a self-supervised brain rate with electroencephalography and deep learning
论文作者
论文摘要
衡量心理工作量的主要原因是量化执行任务以预测人类绩效的认知成本。不幸的是,一种评估具有一般适用性的心理工作量的方法。这项研究提出了一种新型的自我监督方法,用于从脑电图数据中使用深度学习和持续的大脑率,即认知激活的指数,而无需人类声明性知识。该方法是一种可训练的卷积复发性神经网络,该神经网络可通过空间保留脑电图数据的光谱地形图训练,以适合大脑速率变量。发现证明了卷积层从脑电图数据中学习有意义的高级表示的能力,因为受试者内模型的测试平均绝对百分比误差平均为11%。尽管确实提高了其准确性,但增加了用于处理高级表示的序列的长期术语记忆层并不重要。发现指出,认知激活的高级高级表示存在准稳定的块,因为它们可以通过卷积诱导,并且似乎随着时间的流逝并不依赖于彼此,直觉上与大脑反应的非平稳性质相匹配。跨受试者模型,从越来越多的参与者的数据引起的诱导,因此包含更多的可变性,获得了与受试者内模型相似的精度。这突出了人们在人们之间引起的高级表示的潜在普遍性,这表明存在非依赖于受试者的认知激活模式。这项研究通过为学者提供一种用于心理工作负载建模的新型计算方法来促进知识的体系,该方法旨在通常适用,不依赖于支持可复制性和可复制性的临时人工制作的模型。
The principal reason for measuring mental workload is to quantify the cognitive cost of performing tasks to predict human performance. Unfortunately, a method for assessing mental workload that has general applicability does not exist yet. This research presents a novel self-supervised method for mental workload modelling from EEG data employing Deep Learning and a continuous brain rate, an index of cognitive activation, without requiring human declarative knowledge. This method is a convolutional recurrent neural network trainable with spatially preserving spectral topographic head-maps from EEG data to fit the brain rate variable. Findings demonstrate the capacity of the convolutional layers to learn meaningful high-level representations from EEG data since within-subject models had a test Mean Absolute Percentage Error average of 11%. The addition of a Long-Short Term Memory layer for handling sequences of high-level representations was not significant, although it did improve their accuracy. Findings point to the existence of quasi-stable blocks of learnt high-level representations of cognitive activation because they can be induced through convolution and seem not to be dependent on each other over time, intuitively matching the non-stationary nature of brain responses. Across-subject models, induced with data from an increasing number of participants, thus containing more variability, obtained a similar accuracy to the within-subject models. This highlights the potential generalisability of the induced high-level representations across people, suggesting the existence of subject-independent cognitive activation patterns. This research contributes to the body of knowledge by providing scholars with a novel computational method for mental workload modelling that aims to be generally applicable, does not rely on ad-hoc human-crafted models supporting replicability and falsifiability.