sassa

SASSA controversy and “creepy” data

Many South Africans will be familiar with the recent controversy over the renewal of the Net1 contract to pay social grants. I prefer not to engage with the merits of the Net1 decision – ultimately the I do not have access to the facts. The realities of whether an alternative could have, or should have, been…

statistics

Big Data are not only Big but Complex, Messy, Badly Sampled, and Creepy

In researching last weeks post, I came across this great lecture by Professor Thomas Lumley Prof Lumley discusses the role that statisticians must play in data science – in an entertaining and understandable way. Great piece for any aspiring data scientist, or the interested lay person. Data Science: Will Computer Science and Informatics Eat Our Lunch?  Mainstream…

data scientist

Is data science STILL the sexiest job of the 21st century?

When Forbes coined the phrase “sexiest job of the 21st century”  to describe data science, way back in 2012, the role was in its infancy. At the time, the ability to discover new insights from data, using a combination of statistics, machine learning and computer programming, was expected to be thew new competitive differentiator. Data…

easter

Data governance means different things to different people

Easter 2017 has just passed.   For practicing Christians, Easter is an important religious holiday. Arguably, Easter commensurate the founding premise of the Christian faith. In South Africa we celebrate a long weekend – both Easter Friday and the Monday are public holidays. For Christians, the Easter Sunday Church service is one of the most important…

data quality kpi

Data profiling is not data quality

For years, I have been a proponent of data quality measurement. Data quality cannot exist without management (and some would argue without governance). Meaningful data quality metrics play a critical role in managing data quality. Posts such as Don’t blow up the whale;   Changing data behaviour through KPIs, and  Accuracy, Completeness and Speed of Execution…