Designing Scalable Storage and Compute Platforms across On-Prem and Cloud
DOI:
https://doi.org/10.63282/3050-9416.ICAIDSCT26-122Keywords:
Hybrid Cloud, Scalable Storage, Elastic Compute, Cloud Architecture, On-Prem Infrastructure, Kubernetes, Hci, Data Gravity, Workload Portability, Multi-CloudAbstract
Establishing technologies is simplified for enterprises since operating systems may interface with several clouds. Organizations engage extensively in their own data centers, in addition to using public and private cloud infrastructures. This alteration significantly influences the construction, use, and modification of computers and data systems. One of IT's objectives was to facilitate ease of manufacturing. It is now a crucial aspect of managing a firm that facilitates growth, ensures stability, and minimizes expenditures. Organizations must attend to management requirements while simultaneously enhancing their influence and capacity. This is due to the increasing size, complexity, and performance requirements of computer systems. Cloud-native systems are designed to develop and scale progressively. This may provide challenges for legacy or specialized systems that are only offered on-premises. To do this, we must consider power, latency, security, and data gravity. A platform that enables the storage, distribution, and management of data in many formats may not be user-friendly. This impedes the acquisition of new knowledge and progress. It also addresses the separation of the instruments that execute software programs from the programs themselves. Discussions are ongoing about the integration of standard planning, infrastructure-as-code, and policy-driven automation to monitor all scenarios throughout time and facilitate their development. The study indicated that job functions must be fragmented, data must be maintained current, processes must be accelerated, costs must be reduced, and hybrid and multi-cloud systems must operate well.
References
1. Vincent, Kelly P. "When Size Matters: Scalability and the Cloud." A Friendly Guide to Data Science: Everything You Should Know About the Hottest Field in Tech. Berkeley, CA: Apress, 2025. 697-719.
2. Joel, Ayomide. "HYBRID DATA ARCHITECTURE: INTEGRATING ON-PREM HADOOP SYSTEMS WITH AWS EMR DURING TRANSITION." (2024).
3. Jormakka, Jorma, Mani Mehraei, and John Surmont. "Hybrid Cloud ETL Strategies: Federated Processing across On-Prem, Multi-Cloud, and Edge Environments." (2025).
4. Varma, Yasodhara. "Scaling AI: Best Practices in Designing On-Premise & Cloud Infrastructure for Machine Learning." International Journal of AI, BigData, Computational and Management Studies 4.2 (2023): 48-59.
5. Jormakka, Jorma, Mani Mehraei, and John Surmont. "Hybrid Cloud ETL Strategies: Federated Processing across On-Prem, Multi-Cloud, and Edge Environments." (2025).
6. Gaianu, Mihail. "On Premise Data Center vs CLOUD." 2023 International Conference on Computational Science and Computational Intelligence (CSCI). IEEE, 2023.
7. Bonde, Bhushan. "Edge, Fog, and Cloud Against Disease: The Potential of High-Performance Cloud Computing for Pharma Drug Discovery." High Performance Computing for Drug Discovery and Biomedicine (2023): 181-202.
8. Zburivsky, Danil, and Lynda Partner. Designing Cloud Data Platforms. Simon and Schuster, 2021.
9. Vankayalapati, Ravi Kumar. "Cost optimization in hybrid cloud." The Synergy Between Public and Private Clouds in Hybrid Infrastructure Models: Real-World Case Studies and Best Practices (2025): 93.
10. Ahuja, Ashutosh. "A Detailed Study on Cloud and Hybrid Architectures in Enterprises." (2024).
11. Zibitsker, B., and A. Lupersolsky. "How to apply modeling and optimization to select the appropriate cloud platform." (2020).
12. Farajirad, Fatemeh. Transitioning Data from an On-Premise Solution to a Cloud-Based Platform. MS thesis. University of South-Eastern Norway, 2024.
13. Micheal, Lee. "Optimizing Data Workflows in Hybrid Architectures: Balancing Latency, Cost, and Scalability." (2025).
14. James, Micheal. "DESIGNING SCALABLE HYBRID DATA ARCHITECTURES FOR ENTERPRISE WORKLOADS." (2025).
15. Mathur, Prateek. "Cloud computing infrastructure, platforms, and software for scientific research." High Performance Computing in Biomimetics: Modeling, Architecture and Applications (2024): 89-127.