论文标题

B-Pinns:贝叶斯物理信息的神经网络,用于嘈杂数据的前进和逆PDE问题

B-PINNs: Bayesian Physics-Informed Neural Networks for Forward and Inverse PDE Problems with Noisy Data

论文作者

Yang, Liu, Meng, Xuhui, Karniadakis, George Em

论文摘要

我们提出了一个贝叶斯物理学的神经网络(B-PINN),以解决由部分微分方程(PDE)和嘈杂数据描述的前进和非线性问题。在这个贝叶斯框架中,贝叶斯神经网络(BNN)与PDES的PINN相结合,而Hamiltonian Monte Carlo(HMC)或变异推理(VI)可以用作后部估计器。 b小细胞同时利用物理定律和分散的嘈杂测量值来提供预测并量化贝叶斯框架中嘈杂数据引起的差异不确定性。与PINN相比,除了不确定性量化外,B-pinns在噪声较大的情况下获得了更准确的预测,因为它们避免了过度拟合。我们在B-Pinn后验估计的两种不同方法(即HMC或VI)之间进行了系统的比较,以及用于量化深神经网络中不确定性的辍学。我们的实验表明,对于B-Pinns后估计,HMC比VI更适合VI,而PINNS中使用的辍学几乎不能以合理的不确定性提供准确的预测。最后,我们用截短的karhunen-loève(KL)膨胀与HMC或深度归一流流量(DNF)模型作为后估计量代替了BNN。 KL与BNN一样准确,并且速度更快,但是与基于BNN的框架不同,该框架不能轻易扩展到高维问题。

We propose a Bayesian physics-informed neural network (B-PINN) to solve both forward and inverse nonlinear problems described by partial differential equations (PDEs) and noisy data. In this Bayesian framework, the Bayesian neural network (BNN) combined with a PINN for PDEs serves as the prior while the Hamiltonian Monte Carlo (HMC) or the variational inference (VI) could serve as an estimator of the posterior. B-PINNs make use of both physical laws and scattered noisy measurements to provide predictions and quantify the aleatoric uncertainty arising from the noisy data in the Bayesian framework. Compared with PINNs, in addition to uncertainty quantification, B-PINNs obtain more accurate predictions in scenarios with large noise due to their capability of avoiding overfitting. We conduct a systematic comparison between the two different approaches for the B-PINN posterior estimation (i.e., HMC or VI), along with dropout used for quantifying uncertainty in deep neural networks. Our experiments show that HMC is more suitable than VI for the B-PINNs posterior estimation, while dropout employed in PINNs can hardly provide accurate predictions with reasonable uncertainty. Finally, we replace the BNN in the prior with a truncated Karhunen-Loève (KL) expansion combined with HMC or a deep normalizing flow (DNF) model as posterior estimators. The KL is as accurate as BNN and much faster but this framework cannot be easily extended to high-dimensional problems unlike the BNN based framework.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源