论文标题

Wasserstein控制Mirror Langevin Monte Carlo

Wasserstein Control of Mirror Langevin Monte Carlo

论文作者

Zhang, Kelvin Shuangjian, Peyré, Gabriel, Fadili, Jalal, Pereyra, Marcelo

论文摘要

离散的langevin扩散是从log-lipschitz-smooth和(强烈)对数concave的高维目标密度进行采样的有效蒙特卡洛方法。特别是,欧几里得朗格文蒙特·卡洛采样算法最近受到了很多关注,从而详细了解了其非反应性收敛性能,并在收敛速率中平滑性和对数毫无用说的作用。不具备这些规律性属性的分布可以通过考虑捕获对数密度的局部几何形状的riemannian langevin扩散来解决。然而,众所周知,从这种riemannian langevin扩散的离散化中得出的蒙特卡洛算法很难分析。在本文中,我们考虑了在黑森型歧管上的Langevin扩散,并研究了与镜面衰老方案密切相关的离散化。我们首次建立在由此产生的Hessian Riemannian Langevin Monte Carlo算法的采样误差上的非反应上限。根据riemannian度量的地面成本捕获Hessian结构并与自我可信度样条件密切相关,该界限是根据沃斯坦的距离来测量的。上限意味着,例如,迭代的合同朝着朝止的目标密度围绕其半径明确的目标密度。我们的理论恢复了现有的欧几里得结果,并可以应对与高度非平局几何形状有关的各种Hessian指标。

Discretized Langevin diffusions are efficient Monte Carlo methods for sampling from high dimensional target densities that are log-Lipschitz-smooth and (strongly) log-concave. In particular, the Euclidean Langevin Monte Carlo sampling algorithm has received much attention lately, leading to a detailed understanding of its non-asymptotic convergence properties and of the role that smoothness and log-concavity play in the convergence rate. Distributions that do not possess these regularity properties can be addressed by considering a Riemannian Langevin diffusion with a metric capturing the local geometry of the log-density. However, the Monte Carlo algorithms derived from discretizations of such Riemannian Langevin diffusions are notoriously difficult to analyze. In this paper, we consider Langevin diffusions on a Hessian-type manifold and study a discretization that is closely related to the mirror-descent scheme. We establish for the first time a non-asymptotic upper-bound on the sampling error of the resulting Hessian Riemannian Langevin Monte Carlo algorithm. This bound is measured according to a Wasserstein distance induced by a Riemannian metric ground cost capturing the Hessian structure and closely related to a self-concordance-like condition. The upper-bound implies, for instance, that the iterates contract toward a Wasserstein ball around the target density whose radius is made explicit. Our theory recovers existing Euclidean results and can cope with a wide variety of Hessian metrics related to highly non-flat geometries.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源