Integration of DataOps with Automated Exploratory Data Analysis (EDA) Workflows

Abstract

In the age of data-driven innovation, rapid and reliable insight generation is critical. Exploratory Data Analysis (EDA) plays a foundational role in understanding data quality, structure, and relationships. However, traditional EDA processes are time-consuming and often disconnected from the operationalized data pipelines managed by DataOps. This paper explores the integration of DataOps principles with automated EDA workflows, aiming to enhance collaboration, reproducibility, and scalability in modern data ecosystems. By aligning automation tools with robust CI/CD pipelines, teams can streamline data profiling, visualization, and anomaly detection in real time. We propose an architectural framework for this integration, illustrate a practical use case, and discuss the implications for both data engineering and data science teams. This convergence promises a more agile and intelligent approach to data exploration, ensuring faster time-to-insight and improved data trustworthiness.