Distributed Parallelization of Semantic Web Java Applications by Means of the Message-Passing Interface

Alexey Cheptsov () and Matthias Assel ()
Additional contact information
Alexey Cheptsov: University of Stuttgart, High Performance Computing Center Stuttgart (HLRS)
Matthias Assel: University of Stuttgart, High Performance Computing Center Stuttgart (HLRS)

A chapter in High Performance Computing on Vector Systems 2011, 2011, pp 51-64 from Springer

Abstract: Abstract In the recent years, performance has become a key point for a number of Java applications. For some of them, such as from the Semantic Web domain, where the size and the scale of the analyzed data is of a big challenge for a conventional computer, use of the High Performance Computing (HPC) systems is a major factor in achieving the required scalability and performance demands. Parallelization is a key mechanism that leverages HPC for such applications. However, the high development effort for a scalable parallel application has been a major drawback towards the efficient application of HPC to the applications designed for a serial execution only. The Message-Passing Interface (MPI) is a well-known programming standard for large-scale parallel applications development. However, MPI has found its most wide use in the applications written in C and Fortran. We show how MPI can be beneficially applied for the parallelization of the Java applications as well. We describe a parallel implementation of a Random Indexing application that performs similarity search in the large text corpora on the web, which allowed us to improve the performance by up to 33 times on the already 16 nodes of a testbed HPC system.

Keywords: Domain Decomposition; High Performance Computing; Query Expansion; Java Application; Random Indexing (search for similar items in EconPapers)
Date: 2011
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:sprchp:978-3-642-22244-3_4

Ordering information: This item can be ordered from
http://www.springer.com/9783642222443

DOI: 10.1007/978-3-642-22244-3_4

Access Statistics for this chapter

More chapters in Springer Books from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().