Network Programming and Microservices: Building Scalable AI-Driven Distributed Systems for Real-Time Data Processing

  • Authors

    • Rahul Mehta Senior Software Engineer, Wipro Ltd, India. Author
    • Priya Kapoor Business Analyst, Accenture, India. Author

    DOI:

    https://doi.org/10.67228/3142788X/IJMLPA-2020PII8T5V

    Published 12-05-2020

  • Network Programming, Microservices Architecture, Distributed Systems, AI-Driven Systems, Real-Time Data Processing, Scalability, Latency, Fault Tolerance, Event-Driven Architecture, Cloud Computing, Edge Computing, AI Model Deployment

    Issue

    Vol. 3 No. 2 (2020)

    Section

    Articles

    How to Cite

    [1]
    R. Mehta and P. Kapoor, “Network Programming and Microservices: Building Scalable AI-Driven Distributed Systems for Real-Time Data Processing”, IJMLPA, vol. 3, no. 2, pp. 01–11, Dec. 2020, doi: 10.67228/3142788X/IJMLPA-2020PII8T5V.

  • Abstract

    This paper explores the integration of network programming and microservices architecture to build scalable, AI-driven distributed systems for real-time data processing. As artificial intelligence becomes increasingly crucial for real-time decision-making in industries like healthcare, finance, and e-commerce, there is a growing need for systems that can process vast amounts of data efficiently while ensuring scalability and low latency. Network programming techniques are foundational to distributed systems, enabling seamless communication between services. Meanwhile, microservices provide a modular approach that supports scalability and flexibility, essential for AI applications. The paper discusses the role of these technologies in building AI-powered distributed systems, challenges related to network latency, data consistency, and fault tolerance, and real-world applications across industries. Additionally, it delves into future trends such as edge computing and automated scaling in the context of AI-driven distributed systems.

  • References

    [1] Burns, B. (2018). Designing Distributed Systems: Patterns and Paradigms for Scalable, Reliable Services. O'Reilly Media. This book presents patterns for building scalable and reliable distributed applications using containers and microservices.

    [2] Newman, S. (2015). Building Microservices: Designing Fine-Grained Systems. O'Reilly Media.

    [3] Balalaie, A., Heydarnoori, A., Jamshidi, P., & Tamburri, D. A. (2018). “Microservices Migration Patterns.” Software: Practice and Experience, 48(11), 2019–2042. DOI: 10.1002/spe.2608.

    [4] Taibi, D., Lenarduzzi, V., & Pahl, C. (2018). “A Pattern Language for Scalable Microservices-Based Systems.” In Proceedings of the 12th European Conference on Software Architecture (ECSA 2018).

    [5] Osses, F., Marquez, G., & Astudillo, H. (2018). “Exploration of Academic and Industrial Evidence About Architectural Tactics and Patterns in Microservices.” In ICSE 2018 Companion Proceedings.

    [6] Xu, R., Nikouei, S. Y., Chen, Y., Blasch, E., & Aved, A. (2019). “BlendMAS: A Blockchain-Enabled Decentralized Microservices Architecture for Smart Public Safety.” IEEE International Smart Cities Conference.

    [7] Hassan, S., Bahsoon, R., & Kazman, R. (2019). “Microservice Transition and Its Granularity Problem: A Systematic Mapping Study.” arXiv preprint arXiv:1903.11665.

    [8] Collier, R. W., O'Neill, E., Lillis, D., & O'Hare, G. M. P. (2019). “MAMS: Multi-Agent MicroServices.” In Companion Proceedings of the World Wide Web Conference (WWW 2019).

    [9] Dragoni, N., Giallorenzo, S., Lafuente, A. L., Mazzara, M., Montesi, F., Mustafin, R., & Safina, L. (2017). “Microservices: Yesterday, Today, and Tomorrow.” In Present and Ulterior Software Engineering. Springer.

    [10] Kleppmann, M. (2017). Designing Data-Intensive Applications: The Big Ideas Behind Reliable, Scalable, and Maintainable Systems. O'Reilly Media.

    [11] Coulouris, G., Dollimore, J., Kindberg, T., & Blair, G. (2011). Distributed Systems: Concepts and Design (5th ed.). Addison-Wesley.

    [12] Tanenbaum, A. S., & Van Steen, M. (2017). Distributed Systems: Principles and Paradigms (3rd ed.). Pearson.

  • Downloads