Building Fault-Tolerant Microservices with Spring Cloud and Resilience Patterns

  • Authors

    • Venkatesh Satla Full Stack Lead Java Developer at Innosoul, Inc, USA. Author
    • Ramesh Jindam Senior Technical Lead at Wells Fargo, USA. Author

    DOI:

    https://doi.org/10.67228/30715725/IJIARE-2023PII9B2K

    Published 12-08-2023

  • Microservices, Spring Cloud, Spring Boot, Spring Cloud Circuit Breaker, Resilience4j, Fault Tolerance, Distributed Systems, Service Discovery, Load Balancing, Api Gateway, Retry Pattern, Bulkhead Pattern, Cloud-Native Applications

    Issue

    Vol. 6 No. 2 (2023)

    Section

    Articles

  • Abstract

    Microservices architecture enables scalable, flexible, and independently deployable applications but introduces challenges such as service failures, network latency, cascading failures, and system instability. This study explores the integration of Spring Cloud with resilience engineering principles to develop fault-tolerant microservices capable of maintaining business continuity during failures. Key resilience patterns, including Circuit Breaker, Retry, Bulkhead, Rate Limiter, and Fallback, are integrated with Spring Cloud features such as service discovery, configuration management, load balancing, and inter-service communication. A multi-service application is developed and evaluated under service outages, response delays, network interruptions, and peak-load conditions. The experimental results demonstrate reduced service disruption, limited failure propagation, and improved system stability. The study contributes a practical framework for fault-tolerant Spring-based microservices, an evaluation of resilience patterns, and implementation guidance for building reliable and scalable cloud-native applications.

  • References

    [1] Rasheedh, J. Abdul, and S. Saradha. "Design and development of resilient microservices architecture for cloud based applications using hybrid design patterns." Indian J. Comput. Sci. Eng 13.2 (2022): 365-378.

    [2] Parakala, A. (2022). Integrating Salesforce and UiPath: Cross-System Intelligent Automation. International Journal of Emerging Trends in Computer Science and Information Technology, 3(4), 88-99. https://doi.org/10.63282/3050-9246.IJETCSIT-V3I4P109

    [3] Shiramalla, R. (2022). Predictive Record Assignment Engine in Salesforce using LWC and Einstein AI. International Journal of AI, BigData, Computational and Management Studies, 3(3), 147-159. https://doi.org/10.63282/3050-9416.IJAIBDCMS-V3I3P117

    [4] Yin, Kanglin, Qingfeng Du, and Juan Qiu. "Analyse resilience risks in microservice architecture systems with causality search and inference algorithms." International Journal of Web and Grid Services 16.2 (2020): 147-171.

    [5] Baresi, Luciano, and Martin Garriga. "Microservices: The evolution and extinction of web services?." Microservices: Science and Engineering. Cham: Springer International Publishing, 2019. 3-28.

    [6] Muppaneni, K. (2021). HTTP/3 & REST Latency Improvement. International Journal of Emerging Research in Engineering and Technology, 2(1), 122-132. https://doi.org/10.63282/3050-922X.IJERET-V2I1P113

    [7] Kumar Doodala, A. N. (2021). Intelligent EOB/ERA Generation and Validation Framework on Legacy Systems like Mainframes. International Journal of Emerging Research in Engineering and Technology, 2(1), 111-121. https://doi.org/10.63282/3050-922X.IJERET-V2I1P112

    [8] Gutierrez, Felipe. "Spring Cloud." Spring Cloud Data Flow: Native Cloud Orchestration Services for Microservice Applications on Modern Runtimes. Berkeley, CA: Apress, 2020. 89-127.

    [9] Suryadevara, S. S. K. (2021). AI-Driven Multi-Cloud Orchestration System for Enterprise Digital Experience Delivery. American International Journal of Computer Science and Technology, 3(1), 21-34. https://doi.org/10.63282/3117-5481/AIJCST-V3I1P103

    [10] Vppalapati, M., & Talasila, P. K. (2021). Failure without Faults: How Enterprise Storage Systems Degrade Long Before They Break. International Journal of Emerging Trends in Computer Science and Information Technology, 2(1), 115-123. https://doi.org/10.63282/3050-9246.IJETCSIT-V2I1P113

    [11] Behera, L. (2021). Building Resilient Data Pipelines: Techniques for Fault-Tolerant Data Engineering. International Journal of AI, BigData, Computational and Management Studies, 2(3), 46-54. https://doi.org/10.63282/3050-9416.IJAIBDCMS-V2I3P106

    [12] Muppaneni, K. (2021). Cross-Browser Debugging Strategies. American International Journal of Computer Science and Technology, 3(5), 25-36. https://doi.org/10.63282/3117-5481/AIJCST-V3I5P103

    [13] Oleti, Chandra Sekhar. "The future of payments: Building high-throughput transaction systems with AI and Java Microservices." World Journal of Advanced Research and Reviews 16.03 (2022): 1401-1411.

    [14] Allenki, S. S., & Korutla, R. (2021). Agile Development in Practice: From Intern to Contributor. International Journal of Artificial Intelligence, Data Science, and Machine Learning, 2(3), 91-103. https://doi.org/10.63282/3050-9262.IJAIDSML-V2I3P110

    [15] Gaddam, R. R. (2021). Hermetic ML Environments using Conda-Lock and Docker. American International Journal of Computer Science and Technology, 3(4), 22-34. https://doi.org/10.63282/3117-5481/AIJCST-V3I4P103

    [16] Power, Alexander, and Gerald Kotonya. "A microservices architecture for reactive and proactive fault tolerance in iot systems." 2018 IEEE 19th International Symposium on" A World of Wireless, Mobile and Multimedia Networks"(WoWMoM). IEEE, 2018.

    [17] Katangoori, S., & Katangoori, A. (2021). AI-Augmented Data Governance: Enabling Intelligent Access, Lineage, and Compliance across Hybrid Clouds. American International Journal of Computer Science and Technology, 3(6), 36-45. https://doi.org/10.63282/3117-5481/AIJCST-V3I6P104

    [18] Dähling, Stefan, Lukas Razik, and Antonello Monti. "Enabling scalable and fault-tolerant multi-agent systems by utilizing cloud-native computing." Autonomous Agents and Multi-Agent Systems 35.1 (2021): 10.

    [19] Shiramalla, R. (2022). Design of a Unified API Interface Using Workato for Cross-Platform Data Orchestration Between Salesforce and Oracle ERP. International Journal of Emerging Trends in Computer Science and Information Technology, 3(1), 157-168. https://doi.org/10.63282/3050-9246.IJETCSIT-V3I1P118

    [20] Kommuru, Madhurima, and Appala Nooka Kumar Doodala. "Performance Bottlenecks Necks in Data Heavy Python Applications." International Journal of Applied Data Science & Modern Computing 6.2 (2023): 01-19.

    [21] Muppaneni, R. K. (2022). Data Privacy in the Age of AI: How Dynamics 365 Handles Regulatory Challenges. International Journal of Artificial Intelligence, Data Science, and Machine Learning, 3(4), 159-170. https://doi.org/10.63282/3050-9262.IJAIDSML-V3I4P117

    [22] Lakhan, Abdullah, and Xiaoping Li. "Transient fault aware application partitioning computational offloading algorithm in microservices based mobile cloudlet networks: Lakhan A, Li X." Computing 102.1 (2020): 105-139.

    [23] Suryadevara, S. S. K., & Polinati, A. K. (2022). Cross-Cloud Governance Engine Using Policy-as-Code for CMS Platforms. International Journal of Emerging Research in Engineering and Technology, 3(4), 165-175. https://doi.org/10.63282/3050-922X.IJERET-V3I4P118

    [24] Vanapalli, Satyendra Kumar. "Data-Driven Decision Making: Integrating AI Tools with CRM Platforms." International Journal of Applied Data Science & Modern Computing 6.1 (2023): 01-21.

    [25] Flora, José, et al. "A study on the aging and fault tolerance of microservices in kubernetes." IEEE Access 10 (2022): 132786-132799.

    [26] Richter, Daniel, et al. "Highly-available applications on unreliable infrastructure: Microservice architectures in practice." 2017 IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C). IEEE, 2017.

    [27] Vppalapati, M. (2022). The Storage Stack Nobody Draws: Cabling, Panels, and the Illusion of Isolation. International Journal of Emerging Research in Engineering and Technology, 3(2), 211-220. https://doi.org/10.63282/3050-922X.IJERET-V3I2P121

    [28] Heorhiadi, Victor, et al. "Gremlin: Systematic resilience testing of microservices." 2016 IEEE 36th International Conference on Distributed Computing Systems (ICDCS). IEEE, 2016.

    [29] Srigadde, B. R. (2023). Creating Object Quick Actions with Lightning Web Components. International Journal of Artificial Intelligence, Data Science, and Machine Learning, 4(2), 167-180. https://doi.org/10.63282/3050-9262.IJAIDSML-V4I2P118

    [30] Allenki, S. S., & Lee, N. (2022). Performance Tuning Cloud-Hosted Databases: Resource Allocation & Query Optimization. International Journal of AI, BigData, Computational and Management Studies, 3(4), 152-163. https://doi.org/10.63282/3050-9416.IJAIBDCMS-V3I4P116

    [31] Salah, Tasneem, et al. "The evolution of distributed systems towards microservices architecture." 2016 11th International Conference for Internet Technology and Secured Transactions (ICITST). IEEE, 2016.

    [32] Kumar Doodala, A. N. (2022). Strategic Migration for JBoss to IIBM WAS: A Framework for Enterprise-Grade Modernization. International Journal of Emerging Research in Engineering and Technology, 3(2), 161-170. https://doi.org/10.63282/3050-922X.IJERET-V3I2P117

    [33] Gaddam, R. R. (2022). Cost-Aware Autoscaling for Batch vs. Online Inference. International Journal of Emerging Trends in Computer Science and Information Technology, 3(4), 134-143. https://doi.org/10.63282/3050-9246.IJETCSIT-V3I4P113

    [34] Vanapalli, Satyendra Kumar. "Reducing Financial Fraud Using Machine Learning and CRM Data Models." International Journal of Machine Learning and Predictive Analytics 6.2 (2023): 01-20.

    [35] Raj, Pethuru, and G. Sobers Smiles David. "Engineering resilient microservices toward system reliability: The technologies and tools." Cloud Reliability Engineering. CRC Press, 2021. 77-116.

    [36] Srigadde, B. R., & Devaraju, J. M. (2022). The Wrath of Limitations: Lightning Fields and Their Constraints. International Journal of Emerging Research in Engineering and Technology, 3(2), 201-210. https://doi.org/10.63282/3050-922X.IJERET-V3I2P120

    [37] Katangoori, S., & Deore, S. (2022). Edge-Cloud Hybrid Data Pipelines: Architectures for Federated Analytics and Learning. American International Journal of Computer Science and Technology, 4(3), 20-34. https://doi.org/10.63282/3117-5481/AIJCST-V4I3P103

    [38] Muppaneni, R. K. (2020). Retail Reimagined: How Dynamics 365 Commerce Is Driving Omnichannel Experiences. International Journal of AI, BigData, Computational and Management Studies, 1(1), 49-59. https://doi.org/10.63282/3050-9416.IJAIBDCMS-V1I1P106

    [39] Parakala, A. (2021). Building Analytics-Driven Bots: RPA Meets Business Intelligence. International Journal of Emerging Research in Engineering and Technology, 2(1), 77-87. https://doi.org/10.63282/3050-922X.IJERET-V2I1P109

    [40] Lyu, Zhongliang, et al. "Microservice-based architecture for an energy management system." IEEE systems journal 14.4 (2020): 5061-5072.

  • Downloads

Similar Articles

41-50 of 92

You may also start an advanced similarity search for this article.