Real-Time Intelligent Data Engineering for Automated Cross-Border Payments and Regulatory Compliance

  • Authors

    • Dhanaraj Sathiri Independent Researcher, USA. Author
    • Dr. Hannah Svensson Renewable Energy, Scandinavian University of Innovation, Sweden. Author

    DOI:

    https://doi.org/10.67228/30715717/IJDEIC-2025PI4G2D

    Published 01-06-2025

  • Real-Time Payment Processing, Cross-Border Payment Systems, AI-Driven Data Engineering, Autonomous Payment Integration, Financial Data Streaming, Payment Compliance Automation, Low-Latency Data Pipelines, Streaming Data Fusion, Payment Data Quality, Real-Time Financial Analytics

    Issue

    Vol. 8 No. 1 (2025)

    Section

    Articles

    How to Cite

    [1]
    D. . Sathiri and H. Svensson, “Real-Time Intelligent Data Engineering for Automated Cross-Border Payments and Regulatory Compliance”, IJDEIC, vol. 8, no. 1, pp. 01–18, Jan. 2025, doi: 10.67228/30715717/IJDEIC-2025PI4G2D.

  • Abstract

    Real-time processing, AI-driven data engineering, and autonomous integration of payment and compliance functions are critical requirements for improving the efficiency and effectiveness of cross-border payments. Despite recent innovations, the achievement of truly autonomous cross-border payments remains out of reach. Many systems still depend on human intervention as real-time capability is limited to the payment, while compliance processes remain force-fitted thereafter which reduces the efficiency and increases the risk of the overall system. Formal principles of real-time data processing are outlined, together with a formalization of a real-time data engineering pipeline capable of processing the data required to support autonomous cross-border payments. Central to this is the definition of latency requirements for streams of financial data and the steps needed to ensure that these are met. Specific attention is given to the different dimensions of data quality, the notion of streaming data fusion, and the supporting role of regarded components.

  • References

    [1] Carbone, P., Katsifodimos, A., Ewen, S., Markl, V., Haridi, S., & Tzoumas, K. (2015). Apache Flink: Stream and batch processing in a single engine. IEEE Data Engineering Bulletin, 38 (4), 28-38.

    [2] Bandi, V. D. V. K. (2024). AI-Driven Predictive Risk Modeling Architectures for Financial Systems. International Journal Of Finance, 37(3), 54-78.

    [3] Kleppmann, M. (2017). "Designing data-intensive applications,". O'Reilly Media.

    [4] Kolla, S. H., & Peddi, R. K. (2024). Designing Governance-Aligned GenAI Pipelines Using Small Language Models for Enterprise Workflow Intelligence. International Journal of Science, Research and Technology, 7(6), 13256-13268.

    [5] Nagabhyru, K. C. (2024). Data Engineering in the Age of Large Language Models: Transforming Data Access, Curation, and Enterprise Interpretation. Computer Fraud and Security.

    [6] Akidau, T., Bradshaw, R., Chambers, C., Chernyak, S., Fernández-Moctezuma, R. J., Lax, R., McVeety, S., Mills, D., Perry, F., Schmidt, E., & Whittle, S. (2015). "The dataflow model: A practical approach to balancing correctness, latency, and cost in massive-scale unbounded, out-of-order data processing." Proceedings of the VLDB Endowment, 8 (12), 1792-1803.

    [7] Inala, R., & Somu, B. (2024). Agentic ai in retail banking: Redefining customer service and financial decision-making. Journal of Artificial Intelligence and Big Data Disciplines, 1(1), 1-19.

    [8] Ranga Reddy, V. A. (2024). "Comparing Batch vs. Streaming Approaches in Healthcare Data Warehousing Environments." Journal of Neonatal Surgery, 13(1), 2287-2309.

    [9] Kreps, J., Narkhede, N., & Rao, J. (2011). "Kafka: A distributed messaging system for log processing." Proceedings of the NetDB Workshop, 1-7.

    [10] Bandi, V. D. V. K. (2024). Intelligent Data Platforms For Personalized Retail Analytics At Scale. Metallurgical and Materials Engineering, 30(4), 1011-1027.

    [11] Stonebraker, M., Çetintemel, U., & Zdonik, S. (2005). "The 8 requirements of real-time stream processing." ACM SIGMOD Record, 34 (4), 42-47.

    [12] Amistapuram, K. (2024). Smart Decision Support Systems For Dynamic Tax Policy Optimization Using Reinforcement Learning. Available at SSRN.

    [13] Terry, D., Goldberg, D., Nichols, D., & Oki, B. (1995). "Continuous queries over append-only databases." Proceedings of the ACM SIGMOD International Conference on Management of Data, 321-330.

    [14] Kolla, S. H., & Peddi, R. K. (2024). Designing Governance-Aligned GenAI Pipelines Using Small Language Models for Enterprise Workflow Intelligence. International Journal of Science, Research and Technology, 7(6), 13256-13268.

    [15] Babcock, B., Babu, S., Datar, M., Motwani, R., & Widom, J. (2002). Models and issues in data stream systems. "Proceedings of the ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems," 1-16.

    [16] Amistapuram, K. (2024). Generative AI in Insurance: Automating Claims Documentation and Customer Communication. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 15(3), 461-475.

    [17] Nagabhyru, K. C., & Engineer, S. D. (2023). Unifying Data Engineering and Machine Learning Pipelines: An Enterprise Roadmap to Automated Model Deployment.

    [18] Sasi Kumar Kolla, & Venkata Akhilesh Ranga Reddy. (2024). Evaluating Cloud-Native vs. Hybrid Architectures for Health Benefit Administration Systems. International Journal of Medical Toxicology and Legal Medicine, 27(5), 1042-1053. Retrieved from https://ijmtlm.org/index.php/journal/article/view/1483

    [19] Abadi, D. J., Ahmad, Y., Balazinska, M., Çetintemel, U., Cherniack, M., Hwang, J. H., Lindner, W., Maskey, A., Rasin, A., Ryvkina, E., Tatbul, N., Xing, Y., & Zdonik, S. (2005). "The design of the Borealis stream processing engine." Proceedings of the Conference on Innovative Data Systems Research, 277-289.

    [20] Chandrasekaran, S., Cooper, O., Deshpande, A., Franklin, M., Hellerstein, J., Hong, W., Krishnamurthy, S., Madden, S., Reiss, F., & Shah, M. (2003). "TelegraphCQ: Continuous dataflow processing for an uncertain world." Proceedings of the Conference on Innovative Data Systems Research, 269-280.

    [21] Peddi, R. K. (2024). AI-Based Workforce Analytics for SLA Governance and Uptime Assurance in Data Centers. Journal of Computational Analysis and Applications (JoCAAA), 33(08), 8589-8601.

    [22] Vardhan Kumar Bandi, V. D. (2024). Automated Feature Engineering Systems in Large-Scale Healthcare Data Environments. Journal of Neonatal Surgery, 13(1), 2127-2141.

    [23] Deep Learning-Driven Optimization of ISO 20022 Protocol Stacks for Secure Cross-Border Messaging. (2024). MSW Management Journal, 34(2), 1545-1554.

    [24] Yandamuri, U. S. (2023). An Intelligent Analytics Framework Combining Big Data and Machine Learning for Business Forecasting. International Journal Of Finance, 36(6), 682-706.

    [25] Vamsee Pamisetty, Keerthi Amistapuram. (2024). Smart Decision Support Systems For Dynamic Tax Policy Optimization Using Reinforcement Learning. Metallurgical and Materials Engineering, 30(4), 976-995. https://doi.org/10.63278/mme.v30i4.1934

    [26] Dean, J., & Ghemawat, S. (2008). "MapReduce: Simplified data processing on large clusters." Communications of the ACM, 51(1), 107-113.

    [27] Kolla, T. (2024). Graph Neural Networks for HCC Risk Adjustment and Interoperability. International Journal of Science, Research and Technology, 7(6), 13244-13255.

    [28] Kambatla, K., Kollias, G., Kumar, V., & Grama, A. (2014). Trends in big data analytics. "Journal of Parallel and Distributed Computing,". 74 (7), 2561-2573.

    [29] Aitha, A. R. (2023). CloudBased Microservices Architecture for Seamless Insurance Policy Administration. International Journal of Finance (IJFIN)-ABDC Journal Quality List, 36(6), 607-632.

    [30] Armbrust, M., Xin, R. S., Lian, C., Huai, Y., Liu, D., Bradley, J. K., Meng, X., Kaftan, T., Franklin, M. J., Ghodsi, A., & Zaharia, M. (2015). "Spark SQL: Relational data processing in Spark." Proceedings of the ACM SIGMOD International Conference on Management of Data, 1383-1394.

    [31] Nagubandi, A. R. (2023). Advanced Multi-Agent AI Systems for Autonomous Reconciliation Across Enterprise Multi-Counterparty Derivatives, Collateral, and Accounting Platforms. International Journal of Finance (IJFIN)-ABDC Journal Quality List, 36(6), 653-674.

    [32] Kolla, T. (2024). AI-Powered Data Catalog Systems For Healthcare Data Discovery And Governance. South Eastern European Journal of Public Health, 2296-2311. https://doi.org/10.70135/seejph.vi.7077

    [33] Casado, M., Freedman, M. J., Pettit, J., Luo, J., McKeown, N., & Shenker, S. (2007). "Ethane: Taking control of the enterprise." ACM SIGCOMM Computer Communication Review, 37 (4), 1-12.

    [34] Kolla, S. H. (2024). Retrieval-Augmented Enterprise Intelligence: Enhancing Accuracy, Trust, and Operational Decision-Making. International Journal of Future Innovative Science and Technology (IJFIST), 7(2), 12425.

    [35] Crosby, M., Pattanayak, P., Verma, S., & Kalyanaraman, V. (2016). "Blockchain technology: Beyond bitcoin." Applied Innovation Review, 2, 6-19.

    [36] Kolla, S. K. (2024). Federated Machine Learning On Big Healthcare Data For Privacy-Preserving Analytics. The Review of Diabetic Studies, 175-190.

    [37] Garapati, R. S. (2023). Optimizing Energy Consumption in Smart Build-ings Through Web-Integrated AI and Cloud-Driven Control Systems.

    [38] Vukoli?, M. (2015). "The quest for scalable blockchain fabric: Proof-of-work vs. BFT replication." International Workshop on Open Problems in Network Security, 112-125.

    [39] Nakamoto, S. (2008). "Bitcoin: A peer-to-peer electronic cash system." Cryptography Mailing List.

    [40] Davuluri, P. S. L. N. (1936). AI-Driven Data Governance Frameworks for Automated Regulatory Reporting and Audit Readiness. Metallurgical and Materials Engineering, 30 (4), 996-1010.

    [41] Aitha, A. R. (2024). Generative AI-Powered Fraud Detection in Workers' Compensation: A DevOps-Based Multi-Cloud Architecture Leveraging, Deep Learning, and Explainable AI. Deep Learning, and Explainable AI (July 26, 2024).

    [42] ISO 20022 Registration Management Group. (2022). "ISO 20022 universal financial industry message scheme." International Organization for Standardization.

    [43] Kolla, T. (2024). Intelligent Discovery and Governance of Healthcare Data Assets Through AI-Powered Catalog Architectures. International Journal of Emerging Trends in Engineering and Management Research, 9(4), 16083.

    [44] Financial Action Task Force. (2023). "Guidance on digital identity." FATF.

    [45] Committee on Payments and Market Infrastructures. (2020). "Enhancing cross-border payments: Building blocks of a global roadmap." Bank for International Settlements.

    [46] Segireddy, A. R. (2024). Machine Learning-Driven Anomaly Detection in CI/CD Pipelines for Financial Applications. Journal of Computational Analysis and Applications, 33(8).

    [47] Bank for International Settlements. (2021). "Central bank digital currencies: Foundations and core features." BIS Report.

    [48] Reddy, V. A. R. (2024). Generative Intelligence for Healthcare Claims Processing and Personalized Benefits Management. International Journal of Advanced Engineering Science and Information Technology (IJAESIT), 7(3), 14099.

    [49] SWIFT. (2023). "ISO 20022 migration for cross-border payments and reporting." Society for Worldwide Interbank Financial Telecommunication.

    [50] Reddy, V. A. R., & Kolla, S. K. (1984). Infrastructure-As-Code Practices For Regulated Healthcare Cloud Environments. Metallurgical and Materials Engineering, 30 (4), 1028-1042.

    [51] European Banking Authority. (2023). "Guidelines on the use of remote customer onboarding solutions." European Banking Authority.

    [52] Garapati, R. S. (2022). Web-Centric Cloud Framework for Real-Time Monitoring and Risk Prediction in Clinical Trials Using Machine Learning. Current Research in Public Health, 2, 1346.

    [53] Basel Committee on Banking Supervision. (2022). "Principles for operational resilience." Bank for International Settlements.

    [54] Joshi, A., Sujatha, G., Gupta, N., Kumar, R., Sen, M. K., Ish, P., ... & Popalwar, H. (2024). Clinical utility of pulmonary rehabilitation in diffuse parenchymal lung diseases. Journal of Advanced Lung Health, 4(3), 159-165.

    [55] Mangala, N. (2024). Leveraging Microsoft Fabric lakehouse as an AI-ready data platform for enterprise analytics. Journal of Information Systems Engineering and Management.

    [56] Kou, G., Chao, X., Peng, Y., Alsaadi, F. E., & Herrera-Viedma, E. (2021). "Machine learning methods for systemic risk analysis in financial sectors." Technological and Economic Development of Economy, 27 (3), 716-742.

    [57] Reddy Segireddy, A. (2024). Federated Cloud Approaches for Multi-Regional Payment Messaging Systems. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 15(2), 442-450.

    [58] Goodell, G., Aste, T., & Vishnumurthy, V. (2020). "AI governance and explainability for financial services." Frontiers in Artificial Intelligence, 3 , 26.

    [59] Loganathan, R. (2024). Generative AI-enabled compliance documentation and audit trail automation for global data center governance. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 15(3), 487-504.

    [60] Brummer, C., & Yadav, Y. (2019). "Fintech and the innovation trilemma." Georgetown Law Journal, 107 (2), 235-307.

    [61] Kolla, S. K., & Mangalampalli, B. M. (2024). Edge-Based Deep Learning Systems for Point-of-Care Diagnostic Intelligence. Journal of Neonatal Surgery, 13(1), 2387-2399.

    [62] Arner, D. W., Barberis, J., & Buckley, R. P. (2017). "FinTech, RegTech, and the reconceptualization of financial regulation." Northwestern Journal of International Law & Business, 37 (3), 371-413.

    [63] Mattaparthi, R. (2024). Transformer-Based Fault Diagnosis for Large-Scale Standby Power Generators: Partial Discharge Pattern Recognition at Hyperscale Data Center Installations. Journal of Computational Analysis and Applications (JoCAAA), 33(08), 8781-8799.

    [64] Yandamuri, U. S. (2024). AI-Driven Decision Support Systems for Operational Optimization in Hospitality Technology. Metallurgical and Materials Engineering.

    [65] Supriya, Y., Victor, N., Srivastava, G., & Gadekallu, T. R. (2023, May). A hybrid federated learning model for insurance fraud detection. In 2023 IEEE international conference on communications workshops (ICC workshops) (pp. 1516-1522). IEEE.

    [66] Kolla, S. K. (2024). Clinical Knowledge Intelligence through Deep Learning and Natural Language Understanding in Healthcare Platforms. International Journal of Advanced Engineering Science and Information Technology (IJAESIT), 7(3), 14088.

    [67] Zetzsche, D. A., Buckley, R. P., Arner, D. W., & Barberis, J. N. (2017). "Regulating a revolution: From regulatory sandboxes to smart regulation." Fordham Journal of Corporate & Financial Law, 23 (1), 31-103.

    [68] Davuluri, P. N. Integrating Artificial Intelligence into Event-Driven Financial Crime Compliance Platforms.

    [69] Kshetri, N. (2021). "Blockchain and sustainable supply chain management in developing countries." International Journal of Information Management," 60, 102376.

    [70] Avinash Pamisetty, Vijaya Rama Raju Gottimukkala. (2024). Agentic AI-Driven Multi-Cloud Big Data Architecture For Predictive Demand, Credit Risk, And Inventory Financing In National Food Service Supply Chains. Metallurgical and Materials Engineering, 30(4), 959-975. https://doi.org/10.63278/mme.v30i4.1933

    [71] Chen, M., Mao, S., & Liu, Y. (2014). "Big data: A survey. Mobile Networks and Applications," 19 (2), 171-209.

  • Downloads