论文标题
具有随机信号切换时间的GLOSA系统的修改动态编程算法
Modified Dynamic Programming Algorithms for GLOSA Systems with Stochastic Signal Switching Times
论文作者
论文摘要
最近提出了一个离散的随机最佳控制问题,以解决下一个信号切换时间实时确定且因此不确定的情况下,解决了GLOSA(绿光最佳速度咨询)问题。通过SDP(随机动态编程)的相应数值解决方案需要实质性的计算时间,该计算时间不包括车辆在车载计算机中的问题解决方案。为了克服计算时间瓶颈,作为第一次尝试的动态编程版本(称为离散差分动态编程(DDDP)),最近用于随机最佳控制问题的数值解决方案。证明DDDP算法可实现与使用普通SDP算法获得的结果,尽管计算时间大大减少。本工作考虑了动态编程的不同修改版本,称为差分动态编程(DDP)。对于随机的GLOSA问题,证明DDP就CPU时代而言,在MPC(模型预测控制)框架中,在车辆的车载计算机中,可以轻松地在线上可以在线执行提议的方法,从而实现了准实用(非常快)的解决方案。通过使用现实示例来证明这种方法。应当指出,DDP不需要变量离散化,因此获得的溶液可能略优于标准的SDP解决方案。
A discrete-time stochastic optimal control problem was recently proposed to address the GLOSA (Green Light Optimal Speed Advisory) problem in cases where the next signal switching time is decided in real time and is therefore uncertain in advance. The corresponding numerical solution via SDP (Stochastic Dynamic Programming) calls for substantial computation time, which excludes problem solution in the vehicle's on-board computer in real time. To overcome the computation time bottleneck, as a first attempt, a modified version of Dynamic Programming, known as Discrete Differential Dynamic Programming (DDDP) was recently employed for the numerical solution of the stochastic optimal control problem. The DDDP algorithm was demonstrated to achieve results equivalent to those obtained with the ordinary SDP algorithm, albeit with significantly reduced computation times. The present work considers a different modified version of Dynamic Programming, known as Differential Dynamic Programming (DDP). For the stochastic GLOSA problem, it is demonstrated that DDP achieves quasi-instantaneous (extremely fast) solutions in terms of CPU times, which allows for the proposed approach to be readily executable online, in an MPC (Model Predictive Control) framework, in the vehicle's on-board computer. The approach is demonstrated by use of realistic examples. It should be noted that DDP does not require discretization of variables, hence the obtained solutions may be slightly superior to the standard SDP solutions.