Scalable Data Pipelines for Real-time Predictive Maintenance in Edge Computing Environments

  • Authors

    • Dr. Siti Rahman Associate Professor, Universiti Kebangsaan Malaysia, Malaysia. Author
    • Kenji Sato Engineering Director, Sony Corporation, Japan. Author

    DOI:

    https://doi.org/10.67228/30715717/IJDEIC-2021PII1J7P

    Published 08-13-2021

  • Predictive Maintenance, Edge Computing, Scalable Data Pipelines, Real-Time Analytics, Iot, Stream Processing, Machine Learning, Industrial Iot (Iiot), Smart Manufacturing, Fault Detection

    Issue

    Vol. 4 No. 2 (2021)

    Section

    Articles

    How to Cite

    [1]
    S. Rahman and K. Sato, “Scalable Data Pipelines for Real-time Predictive Maintenance in Edge Computing Environments”, IJDEIC, vol. 4, no. 2, pp. 01–09, Aug. 2021, doi: 10.67228/30715717/IJDEIC-2021PII1J7P.

  • Abstract

    Predictive maintenance leverages machine learning and real-time data analytics to anticipate equipment failures before they occur, thereby reducing downtime and optimizing operational efficiency. However, the deployment of such systems in edge computing environments introduces challenges related to latency, scalability, and resource constraints. This paper presents a scalable architecture for data pipelines that enables real-time predictive maintenance at the edge. We propose a modular pipeline design combining lightweight edge processing, efficient data streaming, and cloud-based model orchestration. The architecture is evaluated using industrial sensor data and edge devices in a simulated smart manufacturing environment. Our results demonstrate significant improvements in latency reduction, system scalability, and fault prediction accuracy, validating the effectiveness of the proposed approach for real-world edge deployments.

  • References

    [1] Zhu, M., & Liu, C. (2018). A correlation driven approach with edge services for predictive industrial maintenance. Sensors, 18(6), 1844. https://doi.org/10.3390/s18061844

    [2] Yamato, Y., Kumazaki, H., & Fukumoto, Y. (2016). Realtime predictive maintenance with Lambda architecture. In Proceedings of the 2016 Fourth International Symposium on Computing and Networking (CANDAR) (pp. 713–715). IEEE. https://doi.org/10.1109/CANDAR.2016.0118

    [3] Bose, S. K., Kar, B., Roy, M., Gopalakrishnan, P. K., & Basu, A. (2019). ADEPOS: Anomaly detection based power saving for predictive maintenance using edge computing. In Proceedings of the 24th Asia and South Pacific Design Automation Conference (pp. 597–602). ACM. https://doi.org/10.1145/3287624.3287703

    [4] Cerquitelli, T., Bowden, D., Marguglio, A., Morabito, L., Napione, C., Panicucci, S., Nikolakis, N., Makris, S., Coppo, G., Andolina, S., Macii, A., Macii, E., O'Mahony, N., Becker, P., & Jung, S. (2019). A fog computing approach for predictive maintenance. In Advanced Information Systems Engineering Workshops (Vol. 349, pp. 139–147). Springer. https://doi.org/10.1007/978-3-030-20948-3_13

    [5] de Leon, V., Alcazar, Y., & Villa, J. L. (2019). Use of edge computing for predictive maintenance of industrial electric motors. In Communications in Computer and Information Science (Vol. 1052, pp. 523–533). Springer. https://doi.org/10.1007/978-3-030-31019-6_44

    [6] Zhang, W., Yang, D., & Wang, H. (2019). Data-driven methods for predictive maintenance of industrial equipment: A survey. IEEE Systems Journal, 13(3), 2213–2227. https://doi.org/10.1109/JSYST.2019.2905565

    [7] Yu, W., Dillon, T. S., Liu, Y., & Rahayu, W. (2019). A global manufacturing big data ecosystem for fault detection in predictive maintenance. IEEE Transactions on Industrial Informatics, 16(1), 183–192. https://doi.org/10.1109/TII.2019.2915846

    [8] Rieger, T., Regier, S., Stengel, I., & Clarke, N. (2019). Fast predictive maintenance in Industrial Internet of Things (IIoT) with deep learning: A review. CEUR Workshop Proceedings, 2348, 69–79.

    [9] Renart, E. G., Balouek-Thomert, D., & Parashar, M. (2018). Edge based data-driven pipelines (Technical Report). arXiv. https://arxiv.org/abs/1808.01353

    [10] Sharma, N., & Tham, C. K. (2019). Predictive maintenance using GPU-accelerated partially observable Markov decision process. In Proceedings of the 25th International Conference on Parallel and Distributed Systems (ICPADS) (pp. 769–773). IEEE. https://doi.org/10.1109/ICPADS47876.2019.00113

    [11] Lee, J., Bagheri, B., & Kao, H. A. (2015). A cyber-physical systems architecture for Industry 4.0-based manufacturing systems. Manufacturing Letters, 3, 18–23. https://doi.org/10.1016/j.mfglet.2014.12.001

    [12] Wan, J., Tang, S., Shu, Z., Li, D., Wang, S., Imran, M., & Vasilakos, A. V. (2016). Software-defined industrial Internet of Things in the context of Industry 4.0. IEEE Sensors Journal, 16(20), 7373–7380. https://doi.org/10.1109/JSEN.2016.2565621

    [13] Shi, W., Cao, J., Zhang, Q., Li, Y., & Xu, L. (2016). Edge computing: Vision and challenges. IEEE Internet of Things Journal, 3(5), 637–646. https://doi.org/10.1109/JIOT.2016.2579198

  • Downloads