Cloud-Based Big Data Analytics: Frameworks, Challenges, and Future Trends
DOI:
https://doi.org/10.63282/3050-9262.IJAIBDCMS-V4I1P104Keywords:
Cloud computing, Big data analytics, Hadoop, Apache Spark, Serverless computing, Artificial intelligence, Machine learning, Edge computing, Federated learning, Hybrid cloud, ScalabilityAbstract
A large amount of efficient data has been generated recently due to the increasing technological enhancements. Cloud based big data analytics have become an influential model applying flexibility, scalability, and affordability of the cloud environment for processing unmanageable amounts of data. In this paper, the author discusses the basic tenets of cloud-centered big data analytics, including Hadoop, Apache Spark, and the new serverless architecture. It looks at certain issues, including security, privacy, timeliness, and resource availability, which measure the success of cloud analytics. It also covers new directions through future possibilities that include implementing AI and ML technologies, a growing focus on the edge computing concept, and federated learning for data evaluation. The paper also outlines the trends in the future of big data analytics connected to these developments of native cloud systems and hybrid cloud arrangements. If the current threats are managed and new opportunities capitalized, cloud-based big data analytics shall transform healthcare, finance, smart cities, and IoT industries
References
1. Khan, S., Shakil, K. A., & Alam, M. (2017). Big data computing using cloud-based technologies: Challenges and future perspectives. Networks of the Future, 393-414.
2. Berisha, B., Mëziu, E., & Shabani, I. (2022). Big data analytics in Cloud computing: an overview. Journal of Cloud Computing, 11(1), 24.
3. Zulkernine, F., Martin, P., Zou, Y., Bauer, M., Gwadry-Sridhar, F., & Aboulnaga, A. (2013, June). Towards cloud-based analytics-as-a-service (class) for big data analytics in the Cloud. In 2013 IEEE International Congress on Big Data (pp. 62-69). IEEE.
4. Khan, S., Shakil, K. A., & Alam, M. (2015). Cloud-based big data analytics: a survey of current research and future directions. arXiv preprint arXiv:1508.04733.
5. Al-Jaroodi, J., & Mohamed, N. (2016, November). Characteristics and requirements of big data analytics applications. In 2016 IEEE 2nd International Conference on Collaboration and Internet Computing (CIC) (pp. 426-432). IEEE.
6. Manekar, A., & Pradeepini, G. (2015). A review on cloud-based big data analytics. ICSES Journal on Computer Networks and Communication (IJCNC), 1.
7. Hussin, S. K., Omar, Y. M., Abdelmageid, S. M., & Marie, M. I. (2020). Traditional machine learning and big data analytics in virtual screening: A comparative study. International Journal of Advanced Computer Research, 10(47), 72-88.
8. Jan, B., Farman, H., Khan, M., Imran, M., Islam, I. U., Ahmad, A., ... & Jeon, G. (2019). Deep learning in big data analytics: a comparative study. Computers & Electrical Engineering, 75, 275-287.
9. Cheng, C. C., & Shiu, E. C. (2023). The relative values of big data versus traditional marketing analytics to firm innovation: An empirical study. Information & Management, 60(7), 103839.
10. Aljumah, A. I., Nuseir, M. T., & Alam, M. M. (2021). Traditional marketing analytics, big data analytics and big data system quality and the success of new product development. Business Process Management Journal, 27(4), 1108-1125.
11. Pradhananga, Y., Karande, S., & Karande, C. (2015, February). CBA: cloud-based big data analytics. In 2015 International Conference on Computing Communication Control and Automation (pp. 47-51). IEEE.
12. What is IaaS? Infrastructure as a Service Definition, geeks for geeks, online. https://www.geeksforgeeks.org/infrastructure-as-a-service-iaas/
13. What is PaaS? Platform as a Service in Cloud Computing – Definition, SATS, Types, online. https://63sats.com/blog/platform-as-a-service-in-cloud-computing/
14. SaaS - Software-as-a-Service, Wallarm, online. https://www.wallarm.com/what/what-is-saas
15. Apache Hadoop Architecture Explained (with Diagrams), Phonixnap, online. https://phoenixnap.com/kb/apache-hadoop-architecture-explained
16. Mayilvaganan, M., & Sabitha, M. (2013, December). A cloud-based architecture for Big-Data analytics in smart grid: A proposal. In 2013 IEEE International Conference on Computational Intelligence and Computing Research (pp. 1-4). IEEE.
17. Zhao, M., Kumar, A., Ali, G. M. N., & Chong, P. H. J. (2016, August). A cloud-based network architecture for big data services. In 2016, IEEE 14th Intl Conf on Dependable, Autonomic and Secure Computing, 14th Intl Conf on Pervasive Intelligence and Computing, 2nd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress (DASC/PiCom/DataCom/CyberSciTech) (pp. 654-659). IEEE.
18. Khan, Z., Anjum, A., & Kiani, S. L. (2013, December). Cloud-based big data analytics for smart future cities. In 2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing (pp. 381-386). IEEE.
19. Rahman, M. M., & Hasan, M. H. (2019, October). Serverless architecture for big data analytics. In 2019 Global Conference for Advancement in Technology (GCAT) (pp. 1-5). IEEE.
20. Sampé, J., Vernik, G., Sánchez-Artigas, M., & García-López, P. (2018, December). Serverless data analytics in the IBM cloud. In Proceedings of the 19th International Middleware Conference Industry (pp. 1-8).
21. Khan, S., Shakil, K. A., & Alam, M. (2018). Cloud-based big data analytics—a survey of current research and future directions. Big Data Analytics: Proceedings of CSI 2015, 595-604.