A hybrid forecasting framework based on MCS and machine learning for higher dimensional and unbalanced systems

Guo-Hui Yang, Guang-Yan Zhong, Li-Ya Wang, Zu-Guang Xie and Jiang-Cheng Li

Physica A: Statistical Mechanics and its Applications, 2024, vol. 637, issue C

Abstract: Forecasting methods and theories have been widely researched and applied in complex systems and fields such as statistical physics, econophysics, material crystals, etc. However, challenges persist in applying these methods to complex systems characterized by high dimensionality, data imbalance, and single prediction evaluation. To address these issues, we propose a novel hybrid forecasting approach that integrates the model confidence set (MCS) with machine learning (ML) models. We introduce Principal Component Analysis (PCA) to reduce dimensionality of the data, reduce data imbalance through a combination of random undersampling and oversampling, and introduce several metrics to evaluate the machine learning model set. We also introduce the MCS to select the optimal model from the set of ML models and propose a new combinatorial approach, the MCS-ML combinatorial model. An empirical study is conducted using the example of abnormal transactions in the Bitcoin blockchain. The empirical results show that the proposed MCS-ML combinatorial model has better predictive performance than the models in the ML model set under different data structures.

Keywords: Forecasting; Machine learning; Econophysics; MCS; MCS-ML combinatorial model; Block chain (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0378437124001201
Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:phsmap:v:637:y:2024:i:c:s0378437124001201

DOI: 10.1016/j.physa.2024.129612

Access Statistics for this article

Physica A: Statistical Mechanics and its Applications is currently edited by K. A. Dawson, J. O. Indekeu, H.E. Stanley and C. Tsallis

More articles in Physica A: Statistical Mechanics and its Applications from Elsevier
Bibliographic data for series maintained by Catherine Liu ().