Kolmogorov–Arnold networks with gumbel softmax for recovering network structure and forecasting complex systems

Zhuoran Yang, Juan Zhang, Junping Yin and Wei Yang

Chaos, Solitons & Fractals, 2025, vol. 199, issue P2

Abstract: Reconstructing network connections and dynamics simultaneously is essential for understanding complex systems and developing appropriate strategies. Graph neural networks (GNNs) and Transformers are frequently employed to model dynamics. These models depend on MultiLayer Perceptrons (MLPs) with linear weights and predetermined activation functions to integrate information, which somewhat limits their expressive capability. Additionally, the inferred structure may be inaccurate, as the dynamics and correlations within the complex system are interdependent. As a result, its forecasting ability may be limited. To enhance fitting accuracy of both structure and dynamics, we introduce the Kolmogorov–Arnold Networks (KANs) and Gumbel-softmax technique for modeling continuous and discrete dynamics via spline-parameterized univariate functions and explicit network structure, respectively. Experiments conducted on both simulated data and a real dataset demonstrate that two novel approaches, GGNKAN and more efficient GKAN, can effectively capture the complex and nonlinear functions of the nodes and their interactions, outperforming the Gumbel Graph Networks (GGNs), the state-of-the-art method, in terms of interactions recovery and/or prediction error.

Keywords: KAN; Gumbel softmax; GNN (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0960077925007337
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:chsofr:v:199:y:2025:i:p2:s0960077925007337

DOI: 10.1016/j.chaos.2025.116720

Access Statistics for this article

Chaos, Solitons & Fractals is currently edited by Stefano Boccaletti and Stelios Bekiros

More articles in Chaos, Solitons & Fractals from Elsevier
Bibliographic data for series maintained by Thayer, Thomas R. ().