论文标题

对比地形模型:基于能量的密度模型,用于理解感觉编码和皮层地形

Contrastive Topographic Models: Energy-based density models applied to the understanding of sensory coding and cortical topography

论文作者

Osindero, Simon

论文摘要

我们解决了建立理论模型的问题,该模型有助于阐明视觉大脑在计算/算法和结构/机械水平上的功能。我们试图了解在视觉皮质区域中发现的接收场和地形图如何与基本计算避免的基础相关。我们从概率密度估计的流行角度看待感觉系统的发展;这是由于一个有效的内部代表性计划可能反映了生物体所居住环境的统计结构的观念。我们对模型元素应用基于生物学的约束。 该论文首先调查了来自神经生物学,理论神经科学和机器学习领域的相关文献。经过这篇综述,我们介绍了我们的主要理论和算法发展:我们提出了一类概率模型,我们称其为“基于能量的模型”,并在该框架与其他各种概率模型(例如Markov随机字段和因子图形)之间显示出等效性;我们还开发和讨论了在基于能量的模型中执行最大似然学习和推断的近似算法。然后,论文的其余部分与探索此类模型的特定实例有关。通过执行对模型参数的约束优化,以最大程度地提高适当的自然主义数据集的可能性,我们能够在体内定性地重现许多在体内发现的接收场和MAP属性,同时学习数据中的统计规律性。

We address the problem of building theoretical models that help elucidate the function of the visual brain at computational/algorithmic and structural/mechanistic levels. We seek to understand how the receptive fields and topographic maps found in visual cortical areas relate to underlying computational desiderata. We view the development of sensory systems from the popular perspective of probability density estimation; this is motivated by the notion that an effective internal representational scheme is likely to reflect the statistical structure of the environment in which an organism lives. We apply biologically based constraints on elements of the model. The thesis begins by surveying the relevant literature from the fields of neurobiology, theoretical neuroscience, and machine learning. After this review we present our main theoretical and algorithmic developments: we propose a class of probabilistic models, which we refer to as "energy-based models", and show equivalences between this framework and various other types of probabilistic model such as Markov random fields and factor graphs; we also develop and discuss approximate algorithms for performing maximum likelihood learning and inference in our energy based models. The rest of the thesis is then concerned with exploring specific instantiations of such models. By performing constrained optimisation of model parameters to maximise the likelihood of appropriate, naturalistic datasets we are able to qualitatively reproduce many of the receptive field and map properties found in vivo, whilst simultaneously learning about statistical regularities in the data.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源