Simple physical systems as a reference for multivariate information dynamics
File(s)
Published version
Author(s)
Type
Journal Article
Abstract
Understanding a complex system entails capturing the non-trivial collective phenomena that arise from interactions between its different parts. Information theory is a flexible and robust framework to study such behaviors, with several measures designed to quantify and characterize the interdependencies among the system’s components. However, since these estimators rely on the statistical distributions of observed quantities, it is crucial to examine the relationships between information-theoretic measures and the system’s underlying mechanistic structure. To this end, here, we present an information-theoretic analytical investigation of an elementary system of interactive random walkers subject to Gaussian noise. Focusing on partial information decomposition, causal emergence, and integrated information, our results help us develop some intuitions on their relationship with the physical parameters of the system considered. Specifically, our findings clarify how coarse-graining affects information measures, as well as the mechanistic origin of higher-order behaviors and statistical emergence. Overall, we observe that in this simple scenario, information measures align more reliably with the system’s mechanistic properties when calculated at the level of microscopic components, rather than their coarse-grained counterparts, and over timescales comparable with the system’s intrinsic dynamics. Moreover, we show that approaches that separate the contributions of the system’s dynamics and a steady-state distribution (e.g., via causal perturbations) may help strengthen the interpretation of information-theoretic analyses.
Date Issued
2025-10-01
Date Acceptance
2025-09-24
Citation
Chaos: An Interdisciplinary Journal of Nonlinear Science, 2025, 35 (10)
ISSN
1054-1500
Publisher
AIP Publishing
Journal / Book Title
Chaos: An Interdisciplinary Journal of Nonlinear Science
Volume
35
Issue
10
Copyright Statement
© 2025 Author(s). All article content, except where otherwise noted, is licensed under a Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). https://doi.org/10.1063/5.0276247
License URL
Publication Status
Published
Article Number
103116
Date Publish Online
2025-10-14