Assessment of complexity and dynamical coupling between complex systems using Entropy Rate and Mutual Information Rate Measures: simulations and application to physiological data

Abstract

In this work, after defining the theoretical formulation of ER and MIR dynamical measures, different approaches for their estimation are compared: a linear model-based estimator relying on Gaussian data, two model-free estimators based on discretization of the variables carried out either via uniform quantization through binning or rank ordering through permutations, and a model-free estimator based on direct computation of the differential entropy via k-nearest neighbor searches. The various estimators are first validated and compared on simulated univariate and coupled dynamic systems, including linear autoregressive or mixed non-linear deterministic and linear stochastic dynamics processes. Then, the framework is applied to different datasets of real-world time series describing the dynamics of coupled biomedical physiological systems, including physiological variability series descriptive of cardiovascular and cardiorespiratory interactions assessed at rest and during physiological stress or during controlled breathing conditions.