Integrating data quality and data governance

For someone that’s been preaching data governance and data quality for more than fifteen years, its been fascinating to see how these two topics have been gaining traction in the last few years. A few week’s back I touched on the difference between data governance and data quality – governance is about “what” and “who”,…

The 6 dimensions of big data quality

Historically, data quality has been measured in terms of dimensions including: Accuracy – the degree to which data reflects the real world Completeness – data that is adequately populated Timeliness – That data is available when expected and needed Consistency – that data across all systems reflects the same reality Conformity – that data has…

data quality kpi

Data profiling is not data quality

For years, I have been a proponent of data quality measurement. Data quality cannot exist without management (and some would argue without governance). Meaningful data quality metrics play a critical role in managing data quality. Posts such as Don’t blow up the whale;   Changing data behaviour through KPIs, and  Accuracy, Completeness and Speed of Execution…

Big Data Quality for Hadoop

Big data quality

Ventana’s Research recent Big Data Integration benchmark survey  supports the growing awareness that data quality and integration are the principle time sinks for big data projects. There research finds that more than 50% of the time allocated to any big data project is taken in reviewing the data for quality and consistency – not surprising given…