A New Breakpoint in Hybrid Particle Swarm-Neural Network Architecture: Individual Boundary Adjustment

Rahime Ceylan () and Hasan Koyuncu
Additional contact information
Rahime Ceylan: Department of Electrical and Electronics Engineering, Selcuk University 42250 Konya, Turkey
Hasan Koyuncu: Department of Electrical and Electronics Engineering, Selcuk University 42250 Konya, Turkey

International Journal of Information Technology & Decision Making (IJITDM), 2016, vol. 15, issue 06, 1313-1343

Abstract: Neural Network (NN) is an effective classifier, but it generally uses the Backpropagation type algorithms which are insufficient because of trapping to local minimum of error rate. For elimination of this handicap, stochastic optimization algorithms are used to update the parameters of NN. Particle Swarm Optimization (PSO) is one of these providing a robust coherence with NN. In realized studies about Hybrid PSO-NN, position and velocity boundaries of weight and bias are chosen equal or set free in space which leave the performance of PSO-NN in suspense. In this paper, the limitations of weight velocity (wv), weight position (wp), bias velocity (bv) and bias position (bp) are diversely changed and their effects on the output of hybrid structure are examined. Concerning this, the formed structure is called as Bounded PSO-NN on account of adjusting the optimum operating conditions (intervals). On performance evaluation, proposed method is tested on binary and multiclass pattern classification by using six medical datasets: Wisconsin Breast Cancer (WBC), Pima Indian Diabetes (PID), Bupa Liver Disorders (BLD), Heart Statlog (HS), Breast Tissue (BT) and Dermatology Data (DD). Upon analyzing the results, it was revealed that Bounded PSO-NN has a faster processing time than general PSO-NNs in which set-free and wpi=bpi and wvi=bvi conditions are settled. The superiority in terms of processing time is about 199s (set-free) and 307s (wpi=bpi and wvi=bvi) for training, about 16ms (set-free) and 9ms (wpi=bpi and wvi=bvi) for test. In terms of classification performance, PSO-NN (set-free condition), PSO-NN (wpi=bpi & wvi=bvi) and PSO-NN with individual boundary adjustment (bounded PSO-NN) respectively achieves to accuracy rates as 69.84%, 95.31% and 97.22% on WBC, 47.01%, 76.69% and 77.73% on PID, 55.36%, 67.54% and 73.91% on BLD, 64.82%, 81.48% and 85.56% on HS, 75%, 92.31% and 100% on BT, 27.47%, 92.31% and 100% on DD. In the light of experiments, it is seen that Bounded PSO-NN is better than general PSO-NNs for obtaining the optimum results. Consequently, the importance of limitations is clarified and it is proven that each limitation must be adjusted individually, not be set free or not be chosen equal.

Keywords: Particle swarm optimization; neural networks; hybrid classifier; position-velocity intervals; boundary adjustment (search for similar items in EconPapers)
Date: 2016
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.worldscientific.com/doi/abs/10.1142/S0219622016500395
Access to full text is restricted to subscribers

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wsi:ijitdm:v:15:y:2016:i:06:n:s0219622016500395

Ordering information: This journal article can be ordered from

DOI: 10.1142/S0219622016500395

Access Statistics for this article

International Journal of Information Technology & Decision Making (IJITDM) is currently edited by Yong Shi

More articles in International Journal of Information Technology & Decision Making (IJITDM) from World Scientific Publishing Co. Pte. Ltd.
Bibliographic data for series maintained by Tai Tone Lim ().