aiqbench analysis
This research extends diffusion-based information theory to continuous-time temporal networks by introducing conditional entropy of heat diffusion, addressing limitations caused by non-stationarity and asymmetry. The proposed metric offers an information-theoretic analog of the second law for dynamic systems while enabling effective change-point detection in real-world contact networks. These advancements provide rigorous theoretical tools for analyzing evolving complex systems where traditional graph models fall short.
Conditional Entropy of Heat Diffusion on Temporal Networks
arXiv:2605.21514v2 Announce Type: replace-cross Abstract: Diffusion-based information-theoretic approaches provide new theoretical and practical tools to study complex networks. So far, they have not been generalized to temporal networks. In this work, we show that common entropic measures based on modeling diffusion on graphs, such as the entropy rate and the spectral entropy, do not generalize straightforwardly to temporal networks due to the process's non-stationarity and temporal asymmetries. Instead, we propose the conditional entropy of heat diffusion as an entropic measure for continuous-time temporal networks and study its properties. We show that this quantity is monotone in time, yielding an information-theoretic analog of the second law of thermodynamics for inhomogeneous diffusion on temporal networks. We provide an upper bound and suggest a lower bound on its evolution and explain how discrepancies from it arise due to asymmetric temporal paths. We then introduce a local version of conditional entropy, designed to probe diffusion over finite temporal windows, and show that it provides an informative signal for change-point detection in continuous-time temporal networks. We evaluate the proposed methodology on synthetic benchmarks, including comparative experiments with existing nonparametric baselines in the snapshot setting, and then apply it to a real-world temporal contact network. Finally, we show how to use detected change points to guide community detection on targeted sub-intervals, improving the quality and interpretability of the clustering results.
Abstract:Diffusion-based information-theoretic approaches provide new theoretical and practical tools to study complex networks. So far, they have not been generalized to temporal networks. In this work, we show that common entropic measures based on modeling diffusion on graphs, such as the entropy rate and the spectral entropy, do not generalize straightforwardly to temporal networks due to the process's non-stationarity and temporal asymmetries. Instead, we propose the conditional entropy of heat diffusion as an entropic measure for continuous-time temporal networks and study its properties. We show that this quantity is monotone in time, yielding an information-theoretic analog of the second law of thermodynamics for inhomogeneous diffusion on temporal networks. We provide an upper bound and suggest a lower bound on its evolution and explain how discrepancies from it arise due to asymmetric temporal paths. We then introduce a local version of conditional entropy, designed to probe diffusion over finite temporal windows, and show that it provides an informative signal for change-point detection in continuous-time temporal networks. We evaluate the proposed methodology on synthetic benchmarks, including comparative experiments with existing nonparametric baselines in the snapshot setting, and then apply it to a real-world temporal contact network. Finally, we show how to use detected change points to guide community detection on targeted sub-intervals, improving the quality and interpretability of the clustering results.
Social and Information Networks (cs.SI); Statistical Mechanics (cond-mat.stat-mech); Information Theory (cs.IT); Machine Learning (cs.LG); Data Analysis, Statistics and Probability (physics.data-an)
arXiv:2605.21514 [cs.SI]
(or arXiv:2605.21514v2 [cs.SI] for this version)
Full text under the publisher's open licence · 247 words
Related coverage
From Atoms to Entropy: Optimal Noise Allocation for Diffusion Training in the Convex Regime
arXiv · Jul 24, 2026
PPIM: Pennes Physics-Informed Mamba for Heat-Source-Conditioned 3D Bioheat Simulation
arXiv · Sep 9, 2026
Steering Diffusion Priors with Sparse Observations for High-Resolution Temperature Downscaling
arXiv · Sep 10, 2026
Synthesis Superintelligence: from Semiconductors to Superconductors — Periodic Labs’ Liam Fedus and Ekin Dogus Cubuk
Latent Space · Oct 8, 2026