Data quality and data governance both strive to optimise data and information to meet business needs. Simplistically, however, where Data Governance deals with the definition of, and responsibility for, data management standards, Data Quality deals with the practical implementation, monitoring and enforcement of these data management standards for individual platforms and systems. Both data governance…
The true cost of ELT Today’s business world is demanding more from the data warehouse, because more than ever an organisation’s survival depends on its ability to transform data into actionable insights. However, ELT data integration workloads are now consuming up to 80% of database capacity, resulting in: Rising infrastructure costs Increasing batch windows Longer development cycles Slower…
Data integration defined Data integration is a common industry term referring to the requirement to combine data from multiple separate business systems into a single unified view, often called a single view of the truth. This unified view is typically stored in a central data repository known as a data warehouse. For example, customer data integration involves…
When Harvard Business Review first touted the data scientist as sexiest job of the 21st century back in 2012 the role was still in its infancy. The promise of advanced analytics and the insights that business could gain – about their customers, their interactions, their products and everything else were rightly identified as potential gold. Data…
Data engineering is the term that has emerged to describe the tasks related to delivering useful data for analytics – particularly in relation to data science. With between 60% and 90% of the effort of most big data project allocated to data engineering tasks, the role has matured as organisations found that traditional data scientists…
Not so long ago I received an email which, after giving my personal details, allowed me to download a Gartner report. The report talks about the difficulty organisations have understanding and explaining the role of a data steward. The author starts with mentioning some misconceptions around the role of a data steward, like: It’s a full-time…
Last week, we looked at why we need a business glossary. This week we will discuss what we capture in a business glossary. First, and most obviously, we capture business terms. Business terms A business term is a word or phrase that describes a concept that is used in a particular branch of business. Examples…
