Cost-Efficient Resilient Data Engineering Workloads Using Preemptible Resources

Vishal Mukeshbhai Shah ()

International Journal of Computing and Engineering, 2025, vol. 7, issue 18, 1 - 11

Abstract: This article examines how organizations can optimize cloud computing costs through resilient data engineering workloads on preemptible resources. By leveraging discounted but ephemeral computing offerings from major cloud providers, enterprises can achieve significant cost reductions while maintaining operational reliability. The discussion covers the fundamental characteristics of preemptible computing resources, architectural patterns for resilient data processing, case studies of successful ETL workload optimizations, and applications for machine learning training. Key findings demonstrate that properly designed resilient architectures can withstand interruptions while preserving processing integrity, enabling organizations to harness substantial cost advantages through partitioning, checkpointing, and stateless processing patterns. The article further explores how these architectural approaches not only deliver direct economic benefits but also contribute to enhanced security postures, improved disaster recovery capabilities, and more efficient resource utilization across enterprise computing environments, providing a comprehensive framework for technical leaders seeking to balance cost optimization with operational resilience in increasingly complex cloud ecosystems.

Keywords: Preemptible Computing; Cost Optimization; Resilient Architecture; Data Engineering; Cloud Resources (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://carijournals.org/journals/index.php/IJCE/article/view/3038 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bhx:ojijce:v:7:y:2025:i:18:p:1-11:id:3038

Access Statistics for this article

More articles in International Journal of Computing and Engineering from CARI Journals Limited
Bibliographic data for series maintained by Chief Editor ().