Advanced Python Performance Monitoring with Score-P

Andreas Gocht (), Robert Schöne () and Jan Frenzel ()
Additional contact information
Andreas Gocht: Center for Information Services and High Performance Computing (ZIH), Technische Universität Dresden
Robert Schöne: Center for Information Services and High Performance Computing (ZIH), Technische Universität Dresden
Jan Frenzel: Center for Information Services and High Performance Computing (ZIH), Technische Universität Dresden

A chapter in Tools for High Performance Computing 2018 / 2019, 2021, pp 261-270 from Springer

Abstract: Abstract Within the last years, Python became more prominent in the scientific community and is now used for simulations, machine learning, and data analysis. All these tasks profit from additional compute power offered by parallelism and offloading. In the domain of High Performance Computing (HPC), we can look back to decades of experience exploiting different levels of parallelism on the core, node or inter-node level, as well as utilising accelerators. By using performance analysis tools to investigate all these levels of parallelism, we can tune applications for unprecedented performance. Unfortunately, standard Python performance analysis tools cannot cope with highly parallel programs. Since the development of such software is complex and error-prone, we demonstrate an easy-to-use solution based on an existing tool infrastructure for performance analysis. In this paper, we describe how to apply the established instrumentation framework Score-P to trace Python applications. We finish with a study of the overhead that users can expect for instrumenting their applications.

Keywords: Python; Tools; Performance analysis; Score-P (search for similar items in EconPapers)
Date: 2021
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:sprchp:978-3-030-66057-4_14

Ordering information: This item can be ordered from
http://www.springer.com/9783030660574

DOI: 10.1007/978-3-030-66057-4_14

Access Statistics for this chapter

More chapters in Springer Books from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().