COMPARATIVE PERFORMANCE STUDY OF PARALLEL PROGRAMMING MODELS IN A NEURAL NETWORK TRAINING CODE

Javier E. Vitela, Ulf R. Hanebutte, Jose L. Gordillo and Lucila M. Cortina
Additional contact information
Javier E. Vitela: Instituto de Ciencias Nucleares, Universidad Nacional Autónoma de México, 04510 México D.F., México
Ulf R. Hanebutte: Center for Applied Scientific Computing, Lawrence Livermore National Laboratory, Livermore CA 94551, USA
Jose L. Gordillo: Dir. Gral. Serv. Cómputo Académico, Universidad Nacional Autónoma de México, 04510 México D.F., México
Lucila M. Cortina: Centro de Ciencias de la Atmósfera, Universidad Nacional Autónoma de México, 04510 México D.F., México

International Journal of Modern Physics C (IJMPC), 2002, vol. 13, issue 04, 429-452

Abstract: This paper discusses the performance studies of a coarse grained parallel neural network training code for control of nonlinear dynamical systems, implemented in the shared memory and message passing parallel programming environments OpenMP and MPI, respectively. In addition, these codes are compared to an implementation utilizing SHMEM the native data passing SGI/Cray environment for parallel programming. The multiprocessor platform used in the study is a SGI/Cray Origin 2000 with up to 32 processors, which supports all these programming models efficiently. The dynamical system used in this study is a nonlinear 0D model of a thermonuclear fusion reactor with the EDA-ITER design parameters. The results show that OpenMP outperforms the other two environments when large number of processors are involved, while yielding a similar or a slightly poorer behavior for small number of processors. As expected the native SGI/Cray environment outperforms MPI for the entire range of processors used. Reasons for the observed performance are given. The parallel efficiency of the code is always greater than 60% regardless of the parallel environment for the range of processors used in this study.

Keywords: Neural networks; parallel computing; message passing; shared memory; MPI; OpenMP; SHMEM; coarse grained parallelization; SGI/Cray Origin 2000 (search for similar items in EconPapers)
Date: 2002
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.worldscientific.com/doi/abs/10.1142/S0129183102003887
Access to full text is restricted to subscribers

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wsi:ijmpcx:v:13:y:2002:i:04:n:s0129183102003887

Ordering information: This journal article can be ordered from

DOI: 10.1142/S0129183102003887

Access Statistics for this article

International Journal of Modern Physics C (IJMPC) is currently edited by H. J. Herrmann

More articles in International Journal of Modern Physics C (IJMPC) from World Scientific Publishing Co. Pte. Ltd.
Bibliographic data for series maintained by Tai Tone Lim ().