Building a Trustworthy Data Fabric with End-to-End Lineage and Governance Assurance

  • Authors

    • Dr. Chloe Bernard Associate Professor, University of Paris-Saclay, France. Author

    DOI:

    https://doi.org/10.67228/30715717/IJDEIC-2018PII9C3V

    Published 12-10-2018

  • Data Fabric, Data Lineage, Data Governance, Trustworthy Data Architecture, Metadata Management, Compliance Assurance, Data Transparency, Data Quality, Hybrid Data Management, Policy Automation

    Issue

    Vol. 1 No. 2 (2018)

    Section

    Articles

    How to Cite

    [1]
    C. Bernard, “Building a Trustworthy Data Fabric with End-to-End Lineage and Governance Assurance”, IJDEIC, vol. 1, no. 2, pp. 01–08, Dec. 2018, doi: 10.67228/30715717/IJDEIC-2018PII9C3V.

  • Abstract

    In today’s data-driven enterprises, ensuring trust in data across complex, hybrid, and distributed environments is paramount. A data fabric architecture provides a unified platform for data integration, management, and access, yet the effectiveness of such a platform depends on the integrity and transparency of its operations. This paper explores how a trustworthy data fabric can be built with robust end-to-end lineage and governance assurance. It delves into the technical and organizational challenges of achieving comprehensive data visibility and compliance, highlights architectural approaches, and discusses best practices for embedding governance and lineage into the fabric itself. The paper concludes by examining emerging trends and technologies poised to enhance data trust and governance in the evolving digital landscape.

  • References

    [1] Mosley, M., Brackett, M., Earley, S., & Henderson, D. (Eds.). (2009). The DAMA guide to the data management body of knowledge (DAMA-DMBOK). Technics Publications.

    [2] Hellerstein, J. M. (2008). The declarative imperative: Experiences and conjectures in distributed logic. ACM SIGMOD Record, 39(1), 5–19. https://doi.org/10.1145/1860702.1860705

    [3] Inmon, W. H. (2005). Building the data warehouse (4th ed.). Wiley.

    [4] Khatri, V., & Brown, C. V. (2010). Designing data governance. Communications of the ACM, 53(1), 148–152. https://doi.org/10.1145/1629175.1629210

    [5] Otto, B. (2011). Organizing data governance: Findings from the telecommunications industry and consequences for large service providers. Communications of the Association for Information Systems, 29(1), 45–66.

    [6] Suriarachchi, I., & Plale, B. (2016). Design patterns for data provenance. In Proceedings of the IEEE International Conference on Big Data (pp. 3281–3290). IEEE.

    [7] Chen, D., Doumeingts, G., & Vernadat, F. (2008). Architectures for enterprise integration and interoperability: Past, present and future. Computers in Industry, 59(7), 647–659. https://doi.org/10.1016/j.compind.2007.12.016

    [8] Loshin, D. (2013). The practitioner's guide to data quality improvement. Morgan Kaufmann.

    [9] O'Neil, C. (2016). Weapons of math destruction: How big data increases inequality and threatens democracy. Crown Publishing Group.

    [10] Mayer-Schönberger, V., & Cukier, K. (2013). Big data: A revolution that will transform how we live, work, and think. Houghton Mifflin Harcourt.

    [11] International Organization for Standardization. (2017). ISO/IEC 38505-1:2017: Information technology—Governance of IT—Governance of data—Part 1: Application of ISO/IEC 38500 to the governance of data. ISO.

    [12] Vossen, G. (2011). Metadata management for information integration. Morgan Kaufmann.

    [13] Batini, C., Cappiello, C., Francalanci, C., & Maurino, A. (2009). Methodologies for data quality assessment and improvement. ACM Computing Surveys, 41(3), 1–52. https://doi.org/10.1145/1541880.1541883

    [14] Tallon, P. P., Ramirez, R. V., & Short, J. E. (2013). The information artifact in IT governance: Toward a theory of information governance. Journal of Management Information Systems, 30(3), 141–178. https://doi.org/10.2753/MIS0742-1222300306

    [15] Janssen, M., Charalabidis, Y., & Zuiderwijk, A. (2012). Benefits, adoption barriers and myths of open data and open government. Information Systems Management, 29(4), 258–268. https://doi.org/10.1080/10580530.2012.716740

  • Downloads