论文标题
自动化体系结构搜索受脑启发的超维度计算
Automated Architecture Search for Brain-inspired Hyperdimensional Computing
论文作者
论文摘要
本文代表了探索自动化体系结构搜索超维度计算(HDC)的首次努力,这是一种脑为脑启发的神经网络。目前,HDC设计主要以特定于应用的临时方式进行,这大大限制了其应用。此外,该方法导致了劣质的准确性和效率,这表明HDC无法竞争深度神经网络的竞争性。在此,我们进行了一项详尽的研究,以制定HDC架构搜索空间。在搜索空间之上,我们应用加固学习来自动探索HDC体系结构。搜索的HDC体系结构在涉及药物发现数据集和语言识别任务的案例研究中显示出竞争性能。在Clintox数据集中,由于毒性原因试图从通过/失败的临床试验中学习特征,搜索的HDC架构获得了最先进的ROC-AUC分数,该分数比手动设计的HDC高0.80%,比常规神经网络高9.75%。在语言识别任务上也取得了类似的结果,比传统方法高1.27%。
This paper represents the first effort to explore an automated architecture search for hyperdimensional computing (HDC), a type of brain-inspired neural network. Currently, HDC design is largely carried out in an application-specific ad-hoc manner, which significantly limits its application. Furthermore, the approach leads to inferior accuracy and efficiency, which suggests that HDC cannot perform competitively against deep neural networks. Herein, we present a thorough study to formulate an HDC architecture search space. On top of the search space, we apply reinforcement-learning to automatically explore the HDC architectures. The searched HDC architectures show competitive performance on case studies involving a drug discovery dataset and a language recognition task. On the Clintox dataset, which tries to learn features from developed drugs that passed/failed clinical trials for toxicity reasons, the searched HDC architecture obtains the state-of-the-art ROC-AUC scores, which are 0.80% higher than the manually designed HDC and 9.75% higher than conventional neural networks. Similar results are achieved on the language recognition task, with 1.27% higher performance than conventional methods.