System Architecture Design of Cloud Platforms for Large-Scale Data Processing

Peiyilin Shen

Journal of Sustainability, Policy, and Practice, 2026, vol. 2, issue 2, 67-77

Abstract: Cloud platforms have become essential for managing and processing large-scale datasets in various domains, including scientific research, finance, and social media. Designing robust and scalable system architectures for these platforms is a significant challenge, requiring careful consideration of factors such as data storage, computation, networking, and security. This research article presents a comprehensive overview of system architecture design principles for cloud platforms tailored for large-scale data processing. We explore various architectural patterns, including distributed storage systems, parallel processing frameworks, and resource management strategies. We delve into specific techniques for optimizing data locality, minimizing network latency, and ensuring data consistency across the platform. Furthermore, we investigate the impact of different hardware and software technologies on the performance and scalability of cloud platforms. To validate our proposed design principles and architectures, we present experimental results obtained from deploying and evaluating several prototype cloud platforms using publicly available datasets. These results demonstrate the effectiveness of our approach in achieving high throughput, low latency, and efficient resource utilization. Finally, this article compares and contrasts various state-of-the-art cloud platforms, highlighting their respective strengths and weaknesses. Based on our findings, we propose several research directions for future development in the area of cloud platform architecture for large-scale data processing.

Keywords: Cloud platforms; System architecture; Large-scale data processing; Distributed systems; Scalability; Data locality; Parallel processing (search for similar items in EconPapers)
Date: 2026
References: Add references at CitEc
Citations:

Downloads: (external link)
https://pinnaclepubs.com/index.php/jspp/article/view/682/660 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:dba:jsppaa:v:2:y:2026:i:2:p:67-77

Access Statistics for this article

More articles in Journal of Sustainability, Policy, and Practice from Pinnacle Academic Press
Bibliographic data for series maintained by Joseph Clark ().