论文标题
设计有效的深度学习模型,用于确定路边摄像头图像和天气数据的道路表面状况
Design of Efficient Deep Learning models for Determining Road Surface Condition from Roadside Camera Images and Weather Data
论文作者
论文摘要
冬季的道路维护是一个安全和资源要求的安全操作。它的关键活动之一是确定道路表面状况(RSC),以优先考虑道路并分配清洁工作,例如耕作或盐水。确定RSC的两种常规方法是:通过训练有素的人员进行视觉检查路边摄像机图像,并巡逻道路进行现场检查。但是,由于超过500台摄像机在整个安大略省收集图像,因此视觉检查成为一项资源密集型活动,尤其是在暴风雪期间进行缩放。本文提出了一项研究的结果,重点是提高道路维护操作的效率。我们使用多种深度学习模型从路边摄像头图像和天气变量自动确定RSC,从而扩展了使用类似方法来解决该问题的先前研究。我们使用的数据集是在2017-2018冬季收集的40个连接到安大略省道路天气信息系统(RWIS)的车站,其中包括14.000个标记的图像和70.000个天气测量值。我们训练并评估来自计算机视觉文献的七个最先进模型的性能,包括最近的Densenet,Nasnet和Mobilenet。此外,通过遵循系统的消融实验,我们将先前发表的深度学习模型调整,并将其参数数量减少到约1.3%,与原始参数计数相比,并整合了来自天气变量的观察结果,该模型能够在较差的可见性条件下更好地确定RSC。
Road maintenance during the Winter season is a safety critical and resource demanding operation. One of its key activities is determining road surface condition (RSC) in order to prioritize roads and allocate cleaning efforts such as plowing or salting. Two conventional approaches for determining RSC are: visual examination of roadside camera images by trained personnel and patrolling the roads to perform on-site inspections. However, with more than 500 cameras collecting images across Ontario, visual examination becomes a resource-intensive activity, difficult to scale especially during periods of snowstorms. This paper presents the results of a study focused on improving the efficiency of road maintenance operations. We use multiple Deep Learning models to automatically determine RSC from roadside camera images and weather variables, extending previous research where similar methods have been used to deal with the problem. The dataset we use was collected during the 2017-2018 Winter season from 40 stations connected to the Ontario Road Weather Information System (RWIS), it includes 14.000 labeled images and 70.000 weather measurements. We train and evaluate the performance of seven state-of-the-art models from the Computer Vision literature, including the recent DenseNet, NASNet, and MobileNet. Moreover, by following systematic ablation experiments we adapt previously published Deep Learning models and reduce their number of parameters to about ~1.3% compared to their original parameter count, and by integrating observations from weather variables the models are able to better ascertain RSC under poor visibility conditions.