Research on Resource Prediction and Load Balancing Strategies Based on Big Data in Cloud Computing Platform

Jiaying Huang

Artificial Intelligence and Digital Technology, 2025, vol. 2, issue 1, 49-55

Abstract: Reasonable and accurate resource estimation and good load balancing play a decisive role in the operational performance of large, high-load cloud platforms. This article proposes an intelligent scheduling framework that considers resource estimation, scheduling optimization, and data isolation. In terms of resource estimation, a hybrid prediction model based on LightGBM and LSTM was developed to model key indicators, including CPU, memory, and disk I/O, in a time series context. Experimental results have shown that the average absolute percentage error (MAPE) of the model on the Alibaba Cloud Tianchi dataset is 7.8%. In terms of load balancing optimization, a reinforcement learning method based on Deep Q-Network (DQN) was introduced to achieve dynamic scheduling and resource reallocation of multitasking. In terms of monitoring, closed-loop data collection and decision support are accomplished through Prometheus and Grafana. In order to improve security and model stability in multi-tenant environments, an isolation mechanism combining virtual network segmentation and access control lists (ACLs) is proposed. Tests on enterprise-level private cloud platforms have shown that the framework has increased resource utilization by 22.4% and reduced average response time by 17.3% under peak loads. The specific test results have demonstrated good practicality and utility.

Keywords: cloud computing; resource prediction; load balancing (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://soapubs.com/index.php/aidt/article/view/685/671 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:axf:aidtaa:v:2:y:2025:i:1:p:49-55

Access Statistics for this article

More articles in Artificial Intelligence and Digital Technology from Scientific Open Access Publishing
Bibliographic data for series maintained by Yuchi Liu ().