Skip to content
aiqbench takeAI Research

aiqbench analysis

This research extends diffusion-based information theory to continuous-time temporal networks by introducing conditional entropy of heat diffusion, addressing limitations caused by non-stationarity and asymmetry. The proposed metric offers an information-theoretic analog of the second law for dynamic systems while enabling effective change-point detection in real-world contact networks. These advancements provide rigorous theoretical tools for analyzing evolving complex systems where traditional graph models fall short.
Source coveringarXiv
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

Conditional Entropy of Heat Diffusion on Temporal Networks

arXiv3 min read

arXiv:2605.21514v2 Announce Type: replace-cross Abstract: Diffusion-based information-theoretic approaches provide new theoretical and practical tools to study complex networks. So far, they have not been generalized to temporal networks. In this work, we show that common entropic measures based on modeling diffusion on graphs, such as the entropy rate and the spectral entropy, do not generalize straightforwardly to temporal networks due to the process's non-stationarity and temporal asymmetries. Instead, we propose the conditional entropy of heat diffusion as an entropic measure for continuous-time temporal networks and study its properties. We show that this quantity is monotone in time, yielding an information-theoretic analog of the second law of thermodynamics for inhomogeneous diffusion on temporal networks. We provide an upper bound and suggest a lower bound on its evolution and explain how discrepancies from it arise due to asymmetric temporal paths. We then introduce a local version of conditional entropy, designed to probe diffusion over finite temporal windows, and show that it provides an informative signal for change-point detection in continuous-time temporal networks. We evaluate the proposed methodology on synthetic benchmarks, including comparative experiments with existing nonparametric baselines in the snapshot setting, and then apply it to a real-world temporal contact network. Finally, we show how to use detected change points to guide community detection on targeted sub-intervals, improving the quality and interpretability of the clustering results.

Abstract:Diffusion-based information-theoretic approaches provide new theoretical and practical tools to study complex networks. So far, they have not been generalized to temporal networks. In this work, we show that common entropic measures based on modeling diffusion on graphs, such as the entropy rate and the spectral entropy, do not generalize straightforwardly to temporal networks due to the process's non-stationarity and temporal asymmetries. Instead, we propose the conditional entropy of heat diffusion as an entropic measure for continuous-time temporal networks and study its properties. We show that this quantity is monotone in time, yielding an information-theoretic analog of the second law of thermodynamics for inhomogeneous diffusion on temporal networks. We provide an upper bound and suggest a lower bound on its evolution and explain how discrepancies from it arise due to asymmetric temporal paths. We then introduce a local version of conditional entropy, designed to probe diffusion over finite temporal windows, and show that it provides an informative signal for change-point detection in continuous-time temporal networks. We evaluate the proposed methodology on synthetic benchmarks, including comparative experiments with existing nonparametric baselines in the snapshot setting, and then apply it to a real-world temporal contact network. Finally, we show how to use detected change points to guide community detection on targeted sub-intervals, improving the quality and interpretability of the clustering results.

Social and Information Networks (cs.SI); Statistical Mechanics (cond-mat.stat-mech); Information Theory (cs.IT); Machine Learning (cs.LG); Data Analysis, Statistics and Probability (physics.data-an)

arXiv:2605.21514 [cs.SI]

(or arXiv:2605.21514v2 [cs.SI] for this version)

Full text under the publisher's open licence · 247 words

Related coverage