论文标题
物理学家的直觉：从实验中获得信息
An intuition for physicists: information gain from experiments
论文作者
论文摘要
从实验中学到了多少人可以通过信息增益来量化，也称为kullback-leibler差异。与先前的参数分布$π（θ）$相比，后参数分布的缩小$ p（θ| d）$，以零件单位进行量化，AS：$ d _ {\ Mathrm {kl}}（p |π）= \ int \ log_ {2} \ left（\ frac {p（θ| d）}} {π（θ）} \ right）\，p（θ| d）\，dθ$。本研究说明提供了一个信息增益的意思。它对应于高斯缩小其标准偏差三倍的水平。
How much one has learned from an experiment is quantifiable by the information gain, also known as the Kullback-Leibler divergence. The narrowing of the posterior parameter distribution $P(θ|D)$ compared with the prior parameter distribution $π(θ)$, is quantified in units of bits, as: $ D_{\mathrm{KL}}(P|π)=\int\log_{2}\left(\frac{P(θ|D)}{π(θ)}\right)\,P(θ|D)\,dθ$. This research note gives an intuition what one bit of information gain means. It corresponds to a Gaussian shrinking its standard deviation by a factor of three.
