Learning diverse causally emergent representations from time series data
Author(s)
McSharry, D
Kaplanis, C
Rosas, FE
Mediano, PAM
Type
Conference Paper
Abstract
Cognitive processes usually take place at a macroscopic scale in systems characterised by emergent properties that make the whole 'more than the sum of its parts.' While recent proposals have provided quantitative, information-theoretic metrics to detect emergence in time series data, it is often highly non-trivial to identify the relevant macroscopic variables a priori. In this paper we leverage recent advances in representation learning and differentiable information estimators to put forward a data-driven method to find variables with emergent properties. The proposed method successfully detects variables that exhibit emergent behaviour and recovers the ground-truth emergence values in a synthetic dataset. Furthermore, we show the method can be extended to learn multiple independent features, extracting a diverse set of emergent quantities. We finally show that a modified method scales to real experimental data from several brain activity datasets, paving the ground for future analyses uncovering the emergent structure of cognitive representations in biological and artificial intelligence systems.
Date Issued
2025-02-01
Date Acceptance
2024-12-01
Citation
Advances in Neural Information Processing Systems, 2025, 37, pp.119547-119572
ISSN
1049-5258
Publisher
Neural Information Processing Systems Foundation, Inc. (NeurIPS)
Start Page
119547
End Page
119572
Journal / Book Title
Advances in Neural Information Processing Systems
Volume
37
Copyright Statement
© 2024 Neural Information Processing Systems Foundation, Inc. (NeurIPS).
Source
NeurIPS 2024
Publication Status
Published
Start Date
2024-12-10
Finish Date
2024-12-15
Coverage Spatial
Vancouver, Canada