Energy-Efficient Machine Learning in Cloud Data Warehousing: A Comparative Study on Snowflake and AWS Redshift

  • Authors

    • Sanjay Verma Operations Manager, HCL Technologies, India. Author
    • Dr. Nandhini Ravi Assistant Professor, VIT University, India. Author

    DOI:

    https://doi.org/10.67228/30715717/IJDEIC-2020PII6F2X

    Published 11-13-2020

  • Energy efficiency, Machine learning, Cloud data warehousing, Snowflake, AWS Redshift, Sustainability, Cloud computing, Performance benchmarking, Cost-efficiency, Green computing

    Issue

    Section

    Articles

    How to Cite

    [1]
    S. Verma and N. Ravi, “Energy-Efficient Machine Learning in Cloud Data Warehousing: A Comparative Study on Snowflake and AWS Redshift”, IJDEIC, vol. 3, no. 2, pp. 01–07, Nov. 2020, doi: 10.67228/30715717/IJDEIC-2020PII6F2X.
  • Abstract

    Cloud data warehousing platforms have become pivotal in enabling large-scale machine learning (ML) workloads, but their energy consumption poses significant sustainability challenges. This paper presents a comparative study of two leading cloud data warehousing solutions—Snowflake and AWS Redshift—focusing on their energy efficiency in executing machine learning tasks. By benchmarking a range of ML workloads on both platforms, we evaluate performance, energy consumption, and cost-efficiency. Our findings highlight critical trade-offs and reveal that while both platforms offer robust ML support, differences in architecture and resource management significantly impact their energy profiles. The study provides actionable insights for optimizing ML workloads in cloud data warehouses, contributing to greener and more cost-effective cloud computing practices.

  • References

    [1] Armbrust, M., et al. "A View of Cloud Computing." Communications of the ACM, vol. 53, no. 4, 2010, pp. 50-58.

    [2] DeWitt, D., et al. "Parallel Database Systems: The Future of High Performance Database Systems." Communications of the ACM, vol. 35, no. 6, 1992, pp. 85-98.

    [3] Gantz, J., and Reinsel, D. "The Digital Universe in 2020: Big Data, Bigger Digital Shadows, and Biggest Growth in the Far East." IDC iView, 2012.

    [4] He, Y., et al. "Resource and Energy Efficiency in Cloud Computing." Journal of Network and Computer Applications, vol. 105, 2018, pp. 123-137.

    [5] Ivanov, V., et al. "Energy-Aware Scheduling in Cloud Data Centers." Journal of Systems and Software, vol. 125, 2017, pp. 123-135.

    [6] Jagadish, H.V., et al. "Big Data and Its Technical Challenges." Communications of the ACM, vol. 57, no. 7, 2014, pp. 86-94.

    [7] Kim, J., et al. "Towards Energy-Efficient Machine Learning for Data Centers." Proceedings of the ACM Symposium on Cloud Computing, 2019, pp. 1-12.

    [8] Lee, S., and Zomaya, A. "Energy Efficient Utilization of Resources in Cloud Computing Systems." The Journal of Supercomputing, vol. 60, no. 2, 2012, pp. 268-280.

    [9] Li, Z., et al. "Cloud Data Warehousing: Architecture and Optimization." Data Engineering Bulletin, vol. 38, no. 4, 2015, pp. 40-50.

    [10] Zhang, Q., et al. "Energy-Aware Computing in Cloud Environments: A Survey." IEEE Transactions on Parallel and Distributed Systems, vol. 26, no. 7, 2015, pp. 2019-2031.

  • Downloads