论文标题

关于层合图像重建中的幻觉

On hallucinations in tomographic image reconstruction

论文作者

Bhadra, Sayantan, Kelkar, Varun A., Brooks, Frank J., Anastasio, Mark A.

论文摘要

层析成像图像重建通常是一个不适合的线性反问题。这种不良的逆问题通常使用对对象属性的先验知识进行正规化。最近,通过从训练图像中学习对象属性的先验,已积极研究深度神经网络,以使图像重建问题正规化。但是,对这些深网络学到的先前信息的分析及其概括可能存在于培训分布之外的数据的能力仍在探索。不准确的先验可能会导致虚假的结构在重建的图像中幻觉,这是对医学成像的严重关注的原因。在这项工作中,我们建议通过将图像估计值分解为广义测量和无效组件,以说明通过重建方法施加的先验效果。引入了幻觉图的概念,以理解正规重建方法中先前的效果的一般目的。进行数值研究对应于风格化的层析成像模式。借助数值研究,讨论了所提出的形式主义下不同重建方法的行为。

Tomographic image reconstruction is generally an ill-posed linear inverse problem. Such ill-posed inverse problems are typically regularized using prior knowledge of the sought-after object property. Recently, deep neural networks have been actively investigated for regularizing image reconstruction problems by learning a prior for the object properties from training images. However, an analysis of the prior information learned by these deep networks and their ability to generalize to data that may lie outside the training distribution is still being explored. An inaccurate prior might lead to false structures being hallucinated in the reconstructed image and that is a cause for serious concern in medical imaging. In this work, we propose to illustrate the effect of the prior imposed by a reconstruction method by decomposing the image estimate into generalized measurement and null components. The concept of a hallucination map is introduced for the general purpose of understanding the effect of the prior in regularized reconstruction methods. Numerical studies are conducted corresponding to a stylized tomographic imaging modality. The behavior of different reconstruction methods under the proposed formalism is discussed with the help of the numerical studies.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源