Self-Adaptive Distributed Computing Models for High-Performance Analytics

  • Authors

    • Dr. John Peterson Professor, Stanford University, USA. Author
    • Dr. Linda Martinez Associate Professor, University of California, Berkeley, USA. Author

    DOI:

    https://doi.org/10.67228/30713498/IJADSMC-2025PII4S3D

    Published 12-03-2025

  • Self-Adaptive Computing, Distributed Systems, High-Performance Analytics, Resource Optimization, Machine Learning, Cloud Computing, Big Data Analytics, Intelligent Scheduling

    Issue

    Vol. 8 No. 2 (2025)

    Section

    Articles

    How to Cite

    [1]
    J. Peterson and L. Martinez, “Self-Adaptive Distributed Computing Models for High-Performance Analytics”, IJADSMC, vol. 8, no. 2, pp. 01–18, Dec. 2025, doi: 10.67228/30713498/IJADSMC-2025PII4S3D.

  • Abstract

    The rapid growth of Big Data, IoT, cloud computing, edge intelligence, and AI has increased the demand for scalable and efficient analytical infrastructures. Traditional distributed computing systems often rely on fixed resource allocation and execution strategies, leading to performance issues, resource underutilization, higher latency, and limited scalability under dynamic workloads. To address these challenges, self-adaptive distributed computing models enable systems to autonomously monitor, analyze, and optimize operations in real time. The proposed framework integrates adaptive resource management, intelligent workload scheduling, dynamic task migration, predictive analytics, and machine learning-based optimization to improve computational efficiency and responsiveness. The architecture includes monitoring layers, decision engines, adaptation controllers, distributed resource managers, and analytics execution frameworks. Machine learning techniques such as reinforcement learning, deep neural networks, and predictive modeling support proactive adaptation by forecasting workload demands and optimizing scheduling decisions. Experimental results demonstrate significant improvements in resource utilization, throughput, scalability, fault tolerance, and execution time compared to traditional approaches. Self-healing capabilities further enhance resilience against node failures and network disruptions. Overall, self-adaptive distributed computing provides a scalable, intelligent, and resilient foundation for next-generation high-performance analytics and data-intensive applications.

  • References

    [1] J. Dean and S. Ghemawat, “MapReduce: Simplified Data Processing on Large Clusters,” Communications of the ACM, vol. 51, no. 1, pp. 107–113, Jan. 2008.

    [2] K. Shvachko, H. Kuang, S. Radia, and R. Chansler, “The Hadoop Distributed File System,” in Proc. IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST), Incline Village, NV, USA, 2010, pp. 1–10.

    [3] M. Zaharia, M. Chowdhury, T. Das, A. Dave, J. Ma, M. McCauley, M. Franklin, S. Shenker, and I. Stoica, “Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing,” in Proc. USENIX NSDI, 2012, pp. 15–28.

    [4] M. Zaharia et al., “Apache Spark: A Unified Engine for Big Data Processing,” Communications of the ACM, vol. 59, no. 11, pp. 56–65, Nov. 2016.

    [5] A. Verma, L. Cherkasova, and R. H. Campbell, “ARIA: Automatic Resource Inference and Allocation for MapReduce Environments,” in Proc. ACM ICAC, 2011, pp. 235–244.

    [6] J. O. Kephart and D. M. Chess, “The Vision of Autonomic Computing,” Computer, vol. 36, no. 1, pp. 41–50, Jan. 2003.

    [7] Y. Brun, G. Di Marzo Serugendo, C. Gacek, H. Giese, H. Kienle, M. Litoiu, H. Müller, M. Pezzè, and M. Shaw, “Engineering Self-Adaptive Systems Through Feedback Loops,” in Software Engineering for Self-Adaptive Systems, Berlin, Germany: Springer, 2009, pp. 48–70.

    [8] H. Ghanbari and M. Litoiu, “Identifying and Forecasting Workload Changes in Cloud Environments,” in Proc. IEEE International Conference on Cloud Computing, 2012, pp. 419–426.

    [9] T. Lorido-Botran, J. Miguel-Alonso, and J. A. Lozano, “A Review of Auto-Scaling Techniques for Elastic Applications in Cloud Environments,” Journal of Grid Computing, vol. 12, no. 4, pp. 559–592, 2014.

    [10] R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, 2nd ed. Cambridge, MA, USA: MIT Press, 2018.

    [11] X. Xu, H. Yu, G. Sun, W. Luo, and Y. Chang, “Deep Learning-Based Resource Allocation for Cloud Computing Environments,” IEEE Access, vol. 7, pp. 162695–162705, 2019.

    [12] P. Lama and X. Zhou, “AROMA: Automated Resource Allocation and Configuration of MapReduce Environment in the Cloud,” in Proc. ACM ICAC, Karlsruhe, Germany, 2012, pp. 63–72.

    [13] M. Armbrust et al., “A View of Cloud Computing,” Communications of the ACM, vol. 53, no. 4, pp. 50–58, Apr. 2010.

    [14] W. Wang, X. Wang, D. Feng, J. Liu, Z. Han, and X. Zhang, “Exploring Smart Scheduling for Cloud Computing Using Machine Learning,” IEEE Transactions on Parallel and Distributed Systems, vol. 30, no. 11, pp. 2562–2574, Nov. 2019.

    [15] R. Buyya, C. S. Yeo, S. Venugopal, J. Broberg, and I. Brandic, “Cloud Computing and Emerging IT Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility,” Future Generation Computer Systems, vol. 25, no. 6, pp. 599–616, 2009.

    [16] Gajula, S. (2023). A review of anomaly identification in finance frauds using machine learning system. International Journal of Current Engineering and Technology, 13(6), 568–575. https://ijcet.evegenis.org/index.php/ijcet/article/view/820

    [17] Gajula, S. (2024). Adaptive zero trust architecture for securing financial microservices. Computer Fraud & Security, 2024(12), 643–655. https://doi.org/10.52710/cfs.845.

    [18] Gajula, S. (2024). Cybersecurity risk prediction using graph neural networks. Journal of Information Systems Engineering and Management.

  • Downloads