论文标题

在发现响应vs-covariate动力学的主要因素时,学习了有条件熵和共同信息的学习实用指南

Learned practical guidelines for evaluating Conditional Entropy and Mutual Information in discovering major factors of response-vs-covariate dynamics

论文作者

Chen, Ting-Li, Fushing, Hsieh, Chou, Elizabeth P.

论文摘要

我们将一系列日益复杂的参数统计主题重新制定为响应-VS-Covariate(RE-CO)动力学的框架,这些统计学框架没有任何明确的功能结构。然后,我们通过仅利用数据的分类性质来发现此类重复动态的主要因素来解决这些主题的数据分析任务。分类探索性数据分析(CEDA)范围的主要因素选择方案通过采用Shannon的条件熵(CE)和共同信息($ i [re; co] $)作为两个关键信息理论测量来说明和执行。通过评估这两种基于熵的测量和解决统计任务的过程,我们获得了几项计算指南,以执行DO-Alt-Learn方式执行主要因素选择方案。具体而言,制定了用于评估CE和$ i [RE的实用准则; co] $符合称为[C1:可确认]的标准。通过[C1:可确认]标准,我们没有尝试获得对这些理论信息测量值的一致估计。所有评估均在应急表平台上进行,实际准则还提供了减轻维度诅咒影响的方法。我们明确地执行了六个重新CO动态示例,在其中,还探索和讨论了几个广泛扩展的方案。

We reformulate and reframe a series of increasingly complex parametric statistical topics into a framework of response-vs-covariate (Re-Co) dynamics that is described without any explicit functional structures. Then we resolve these topics' data analysis tasks by discovering major factors underlying such Re-Co dynamics by only making use of data's categorical nature. The major factor selection protocol at the heart of Categorical Exploratory Data Analysis (CEDA) paradigm is illustrated and carried out by employing Shannon's conditional entropy (CE) and mutual information ($I[Re; Co] $) as two key Information Theoretical measurements. Through the process of evaluating these two entropy-based measurements and resolving statistical tasks, we acquire several computational guidelines for carrying out the major factor selection protocol in a do-and-learn fashion. Specifically, practical guidelines are established for evaluating CE and $I[Re; Co] $ in accord with the criterion called [C1:confirmable]. Via [C1:confirmable] criterion, we make no attempts on acquiring consistent estimations of these theoretical information measurements. All evaluations are carried out on a contingency table platform, upon which the practical guidelines also provide ways of lessening effects of curse of dimensionality. We explicitly carry out six examples of Re-Co dynamics, within each of which, several widely extended scenarios are also explored and discussed.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源