Performance Analysis of Fully Connected Parametric Activation Functions

Rashmi Awasthi and B.K. Sharma

International Journal of Scientific Research in Computer Science, Engineering and Information Technology, 2023, vol. 9, issue 2, 613-617

Abstract: Modern studies have shown that the choice of activation function can significantly affect the performance of several learning methods and deep networks. The activation function plays an important role in solving the nonlinear problem, and various nonlinear fully connected activation functions have been studied. In this paper, we propose a combined parametric activation function that can improve the performance of a fully connected Artificial intelligence methods and neural network. Combined parametric activation functions can be created by simply adding parametric activation functions. The parametric activation function is a function that can be optimized in the direction of minimizing the loss function by applying a appropriate parameter that converts the scale and location of the activation function according to the input data. The development of Artificial Neural Networks (ANNs) has achieved a lot of fruitful results so far, and we know that activation function is one of the principal factors which will affect the performance of the networks. In this paper, we discussed about the impact of varying model width and depth on robustness, the impact of using learnable parametric activation functions (PAFs).

Keywords: Combined parametric functions; Artificial Intelligence; Artificial Neural Networks (ANN); Machine Learning; Deep Learning. (search for similar items in EconPapers)
Date: 2023
Note: Article URL: https://ijsrcseit.com/CSEIT2390287
References: Add references at CitEc
Citations:

Downloads: (external link)
https://ijsrcseit.com/CSEIT2390287 Article URL (text/html)
https://ijsrcseit.com/paper/CSEIT2390287.pdf Full text (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:jbh:ijsrcs:v9:y2023:i2:id:hcseit2390287

DOI: 10.32628/CSEIT2390287

Access Statistics for this article

More articles in International Journal of Scientific Research in Computer Science, Engineering and Information Technology from International Journal of Scientific Research in Computer Science, Engineering and Information Technology
Bibliographic data for series maintained by Pankaj Sharma (USA) ().