ReLU-type Hopfield neural network with analog hardware implementation

Chengjie Chen, Fuhong Min, Yunzhen Zhang and Han Bao

Chaos, Solitons & Fractals, 2023, vol. 167, issue C

Abstract: Rectified Linear Unit (ReLU) is an extremely simple activation function with two-segment linearity and is usually used in convolutional neural network. To simplify the analog hardware implementation, this article presents a bi-neuron Hopfield neural network (HNN) using ReLU function instead of hyperbolic tangent (Tanh) function as the activation function. With the HNN model, the boundedness properties can be proved by virtue of the Lyapunov method and the stability distributions of time-varying equilibrium point are clarified according to four independent affine regions. Using numerical measures, complex dynamical behaviors are uncovered therein, including period-adding bifurcation, spiking/bursting pattern, fast-slow effect, and coexisting multistable patterns. In addition, a multiplierless electronic circuit is developed for implementing the HNN model and its experimental measurements well validate the numerical ones. The results manifest that the ReLU-type HNN model can display intricate and rich dynamics, and its analog hardware implementation is simpler than other HNN models.

Keywords: Analog hardware implementation; Numerical measure; Hopfield neural network (HNN); ReLU function; Stability (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (4)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0960077922012474
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:chsofr:v:167:y:2023:i:c:s0960077922012474

DOI: 10.1016/j.chaos.2022.113068

Access Statistics for this article

Chaos, Solitons & Fractals is currently edited by Stefano Boccaletti and Stelios Bekiros

More articles in Chaos, Solitons & Fractals from Elsevier
Bibliographic data for series maintained by Thayer, Thomas R. ().