Making use of supercomputers in financial machine learning

Philippe Cotte (), Pierre Lagier (), Vincent Margot () and Christophe Geissler ()
Additional contact information
Philippe Cotte: Advestis
Pierre Lagier: Fujitsu Laboratories of Europe Ltd. - Fujitsu Laboratories Ltd.
Vincent Margot: Advestis
Christophe Geissler: Advestis

Working Papers from HAL

Abstract: This article is the result of a collaboration between Fujitsu and Advestis. This collaboration aims at refactoring and running an algorithm based on systematic exploration producing investment recommendations on a high-performance computer of the Fugaku, to see whether a very high number of cores could allow for a deeper exploration of the data compared to a cloud machine, hopefully resulting in better predictions. We found that an increase in the number of explored rules results in a net increase in the predictive performance of the final ruleset. Also, in the particular case of this study, we found that using more than around 40 cores does not bring a significant computation time gain. However, the origin of this limitation is explained by a threshold-based search heuristic used to prune the search space. We have evidence that for similar data sets with less restrictive thresholds, the number of cores actually used could very well be much higher, allowing parallelization to have a much greater effect.

Keywords: XAI; Multiprocessing; Parallel Programming; High Performance Computing; Expert Systems; rule-based algorithm; Portfolio Management; RIPE (search for similar items in EconPapers)
Date: 2022-02-28
New Economics Papers: this item is included in nep-big and nep-cmp
Note: View the original document on HAL open archive server: https://hal.science/hal-03590926
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://hal.science/hal-03590926/document (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hal:wpaper:hal-03590926

Access Statistics for this paper

More papers in Working Papers from HAL
Bibliographic data for series maintained by CCSD ().