Integral Neuron: A New Concept for Nonlinear Neuron Modeling Using Weight Functions. Creation of XOR Neurons

Kostadin Yotov, Emil Hadzhikolev and Stanka Hadzhikoleva ()
Additional contact information
Kostadin Yotov: Faculty of Mathematics and Informatics, University of Plovdiv Paisii Hilendarski, 236 Bulgaria Blvd., 4027 Plovdiv, Bulgaria
Emil Hadzhikolev: Faculty of Mathematics and Informatics, University of Plovdiv Paisii Hilendarski, 236 Bulgaria Blvd., 4027 Plovdiv, Bulgaria
Stanka Hadzhikoleva: Faculty of Mathematics and Informatics, University of Plovdiv Paisii Hilendarski, 236 Bulgaria Blvd., 4027 Plovdiv, Bulgaria

Mathematics, 2024, vol. 12, issue 24, 1-44

Abstract: In the present study, an extension of the idea of dynamic neurons is proposed by replacing the weights with a weight function that is applied simultaneously to all neuron inputs. A new type of artificial neuron called an integral neuron is modeled, in which the total signal is obtained as the integral of the weight function. The integral neuron enhances traditional neurons by allowing the signal shape to be linear and nonlinear. The training of the integral neuron involves finding the parameters of the weight function, where its functional values directly influence the total signal in the neuron’s body. This article presents theoretical and experimental evidence for the applicability and convergence of standard training methods such as gradient descent, Gauss–Newton, and Levenberg–Marquardt in searching for the optimal weight function of an integral neuron. The experimental part of the study demonstrates that a single integral neuron can be trained on the logical XOR function—something that is impossible for single classical neurons due to the linear nature of the summation in their bodies.

Keywords: integral neuron; XOR neuron; weight function; integral neural network; dynamic artificial neural networks (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/12/24/3982/pdf (application/pdf)
https://www.mdpi.com/2227-7390/12/24/3982/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:12:y:2024:i:24:p:3982-:d:1546850

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().