Representing significant dependencies with variable orders in networks

Jiaxu Li, Xiaoqian Yuan, Yude Fu, Jichao Li, Wenhui Tan and Xin Lu

Chaos, Solitons & Fractals, 2025, vol. 201, issue P2

Abstract: Higher-order networks (HONs) have demonstrated remarkable effectiveness in capturing higher-order dependencies in complex systems, revealing crucial non-Markovian group interactions involving three or more components. However, existing HON models face two primary limitations: (1) inadequate handling of the coexistence of dependencies with variable orders, and (2) low model interpretability. To address these challenges, we propose Significant Dependencies with Variable Orders Mining (SDVOM), a method utilizing hypothesis testing and Markov Chain Monte Carlo (MCMC) techniques to automatically identify statistically significant dependencies with variable orders from data. Furthermore, we introduce the SDVO-HON model, a novel HON framework that embeds these significant dependencies in a higher-order pattern tree structure, enhancing model interpretability through the explicit representation of dependencies with variable orders. Evaluations on synthetic clickstream datasets embedding user preference patterns with variable orders demonstrate that SDVOM uniquely maintains a low Type I error rate while generating zero Type II errors across all experimental settings, outperforming existing state-of-the-art methods. We further applied SDVOM and the SDVO-HON model to real-world transportation and communication networks, demonstrating that SDVOM identifies significant dependencies with 99% confidence and eliminates over 97% of non-significant dependencies. The SDVO-HON model significantly improves network analysis tasks, enhancing the identification of high-impact employees in organizational networks and hub cities in high-speed rail systems. Overall, the proposed method provides a powerful tool for analyzing complex real-world data, substantially advancing the interpretability and representative power of HON models.

Keywords: Dependencies with variable orders; Higher-order network models; Higher-order Markov chains; Hypothesis testing (search for similar items in EconPapers)
Date: 2025
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0960077925014183
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:chsofr:v:201:y:2025:i:p2:s0960077925014183

DOI: 10.1016/j.chaos.2025.117405

Access Statistics for this article

Chaos, Solitons & Fractals is currently edited by Stefano Boccaletti and Stelios Bekiros

More articles in Chaos, Solitons & Fractals from Elsevier
Bibliographic data for series maintained by Thayer, Thomas R. ().