论文标题
NAS:基于在线神经进化的神经架构搜索时间序列预测
ONE-NAS: An Online NeuroEvolution based Neural Architecture Search for Time Series Forecasting
论文作者
论文摘要
时间序列预测(TSF)是数据科学中最重要的任务之一,因为准确的时间序列(TS)预测可以推动和推进各种领域,包括金融,运输,医疗保健和电力系统。但是,由于预验证的模型能够学习和适应不可预测的模式,因此对机器学习的现实利用(ML)模型会受到影响,因为以前看不见的数据在较长的时间范围内到达。为了解决这个问题,必须定期保留或重新设计模型,这需要大量的人类和计算资源。这项工作介绍了基于在线神经进化的神经体系结构搜索(NAS)算法,据作者所知,该算法是第一个能够在在线环境中自动设计和培训新的复发性神经网络(RNN)的神经体系结构搜索算法。在没有任何预训练的情况下,一日道利用了RNN的种群,这些RNN不断使用新的网络结构和权重,以响应新的多元输入数据。对现实世界大规模的多元风力涡轮机数据进行了测试,以及单变量的道琼斯工业平均水平(DJIA)数据集,并显示出优于传统的传统统计时间序列预测,包括天真的,移动的平均水平和指数平滑的方法,以及艺术在线Arima Arima策略的状态。
Time series forecasting (TSF) is one of the most important tasks in data science, as accurate time series (TS) predictions can drive and advance a wide variety of domains including finance, transportation, health care, and power systems. However, real-world utilization of machine learning (ML) models for TSF suffers due to pretrained models being able to learn and adapt to unpredictable patterns as previously unseen data arrives over longer time scales. To address this, models must be periodically retained or redesigned, which takes significant human and computational resources. This work presents the Online NeuroEvolution based Neural Architecture Search (ONE-NAS) algorithm, which to the authors' knowledge is the first neural architecture search algorithm capable of automatically designing and training new recurrent neural networks (RNNs) in an online setting. Without any pretraining, ONE-NAS utilizes populations of RNNs which are continuously updated with new network structures and weights in response to new multivariate input data. ONE-NAS is tested on real-world large-scale multivariate wind turbine data as well a univariate Dow Jones Industrial Average (DJIA) dataset, and is shown to outperform traditional statistical time series forecasting, including naive, moving average, and exponential smoothing methods, as well as state of the art online ARIMA strategies.