High Performance Computing for Analyzing PB-Scale Data in Nuclear Experiments and Simulations

Takayuki Tatekawa (), Naoya Teshima (), Noriyuki Kushida (), Hiroko Nakamura Miyamura (), Guehee Kim () and Hiroshi Takemiya ()
Additional contact information
Takayuki Tatekawa: Center for Computational Science and e-Systems (CCSE), Japan Atomic Energy Agency (JAEA)
Naoya Teshima: Center for Computational Science and e-Systems (CCSE), Japan Atomic Energy Agency (JAEA)
Noriyuki Kushida: Center for Computational Science and e-Systems (CCSE), Japan Atomic Energy Agency (JAEA)
Hiroko Nakamura Miyamura: Center for Computational Science and e-Systems (CCSE), Japan Atomic Energy Agency (JAEA)
Guehee Kim: Center for Computational Science and e-Systems (CCSE), Japan Atomic Energy Agency (JAEA)
Hiroshi Takemiya: Center for Computational Science and e-Systems (CCSE), Japan Atomic Energy Agency (JAEA)

A chapter in High Performance Computing on Vector Systems 2011, 2011, pp 107-117 from Springer

Abstract: Abstract By performance improvement of computers and expansion of experiment facilities, output data having became huge. In near future, the output data will become petabyte (PB)-scale. It will become increasingly important how huge data is analyzed efficiently and derive useful information. To analysis huge data efficiently, we are constructing large-scale data integrated analysis system which treats terabytes-petabytes data. In this system, two elemental technologies, i.e., heterogeneous processor and distributed parallel computing framework with fault-tolerance are implemented. The former and the latter are effective for computation dominant processes and data I/O dominant processes, respectively. First, we have applied acceleration by the heterogeneous processor to experimental data and estimated its performance. The processor accelerated experimental data processing substantially. Next, then we have constructed a prototype of distributed parallel computing system for simulation data and carried out processing test. We have found the notice points for application these elemental techniques.

Keywords: Hadoop Distribute File System; Neutron Radiography; Elemental Technology; Seismic Response Analysis; Hadoop Cluster (search for similar items in EconPapers)
Date: 2011
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:sprchp:978-3-642-22244-3_8

Ordering information: This item can be ordered from
http://www.springer.com/9783642222443

DOI: 10.1007/978-3-642-22244-3_8

Access Statistics for this chapter

More chapters in Springer Books from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().