Parameter training methods for convolutional neural networks with adaptive adjustment method based on Caputo fractional-order differences

Haiming Zhao, Honggang Yang, Jiejie Chen, Ping Jiang and Zhigang Zeng

Chaos, Solitons & Fractals, 2025, vol. 199, issue P1

Abstract: As deep learning technologies continue to permeate various sectors, optimization algorithms have become increasingly crucial in neural network training. This paper introduces two adaptive momentum algorithms based on Grünwald–Letnikov and Caputo fractional-order differences—Fractional Order Adagrad (FAdagrad) and Fractional Order Adam (FAdam)—to update parameters more flexibly by adjusting momentum information. Commencing from the definitions of fractional derivatives, we propose integrating fractional-order differences with gradient algorithms in convolutional neural networks (CNNs). These adaptive momentum algorithms, leveraging Grünwald–Letnikov and Caputo fractional-order differences, offer enhanced flexibility, thereby accelerating convergence. Our nonlinear parameter tuning method for CNNs demonstrates superior performance compared to traditional integer-order momentum algorithms and the standard Adam algorithm. Experimental results on the BraTS2021 dataset and CIFAR-100 dataset reveal that the proposed fractional-order optimization algorithms significantly outperform their integer-order counterparts in model optimization. They not only expedite convergence but also improve the accuracy of image recognition and segmentation.

Keywords: Deep learning; Fractional-order differences; Adaptive momentum algorithms; Convolutional neural networks (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0960077925006010
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:chsofr:v:199:y:2025:i:p1:s0960077925006010

DOI: 10.1016/j.chaos.2025.116588

Access Statistics for this article

Chaos, Solitons & Fractals is currently edited by Stefano Boccaletti and Stelios Bekiros

More articles in Chaos, Solitons & Fractals from Elsevier
Bibliographic data for series maintained by Thayer, Thomas R. ().