Higher-Order Interactions and Their Duals Reveal Synergy and Logical Dependence beyond Shannon-Information
高阶交互及其对偶:揭示超越香农信息的协同与逻辑依赖
Information-theoretic quantities reveal dependencies among variables in the structure of joint, marginal, and conditional entropies, but leave some fundamentally different systems indistinguishable. Furthermore, there is no consensus on how to construct and interpret a higher-order generalisation of mutual information (MI). In this manuscript, we show that a recently proposed model-free definition of higher-order interactions amongst binary variables (MFIs), like mutual…