Skip to content

Data Quality Matters

Data integrity – Unlock the value in your enterprise information asset

Primary Menu

  • Main Site
  • Data Quality
  • Data Governance
  • Big Data
  • Master Data Management
  • Compliance
  • About
    • Contact us

Tag Data warehouse

Is your new data warehouse valid?

February 18, 2020January 29, 2020Gary Allemann Leave a comment

Remember when legacy meant the mainframe?

Advances in technology mean that many corporations are looking to modernise and replace client server applications or data warehouse platforms that were deployed within the last decade. Client server is the new legacy.

Tweet

Whether this deployment will be to the cloud – or to simpler more cost-effective technologies deployed in house a common challenge faces the developer

How do we ensure that our new design meets existing requirements?

Legacy data warehouses have been built up over time to consolidate data sets to meet the varying needs of a multitude of business stake holders, each with their own, special reporting needs.

The data models, similarly, have been designed with these stake holders needs in mind. Typically, these models have grown organically to meet additional and varied needs over time.

A new, optimised model may be desirable to provide enhanced performance. Or it may be necessary to meet changing demands – think “privacy by design” or the new aggregation demands being driven by globalisation.

How can you ensure that your new design still runs the old reports?

Enter data sufficiency analysis

Data sufficiency analysis mean making sure that every column in the exisitng data warehouse maps to a similar column in the planned structure.

Similarly, data aggregations and transformations may be built in to the structure of the existing warehouse, in the form of stored procedures, that must be reverse engineered and replicated.

Trying to do this manually is an exercise in pain.

It can run to many thousands of man hours and experience shows that this will still leave unidentified gaps in the process.

These gaps introduce risks into the development phase that may well mean redevelopment or a failure to deliver existing reports to key stakeholders.

The difference of Manta tools

MANTA automates technical metadata discovery and lineage across a range of common database systems, ETL tools and reporting platforms presenting results in an intuitive GUI front end.

In one case study MANTA was able to analyse and document a complex enterprise data warehouse environment – including data structures, SQL scripts and ETL processes – in days, saving thousands of man hours, reducing risk and ensuring that existing needs were catered for in the planned design.

Talk to us to understand how using MANTA can help you

Posts navigation

← Older posts

Join 1,703 other followers

RSS Upcoming events

  • An error has occurred; the feed is probably down. Try again later.

Call us

Johannesburg, South Africa
+27114854856
mdm@masterdata.co.za

Top Posts & Pages

  • What is a business term?
    What is a business term?
  • What is the difference between Data Governance and Data Stewardship?
    What is the difference between Data Governance and Data Stewardship?
  • Why do you need data governance?
    Why do you need data governance?
  • The 1-10-100 rule
    The 1-10-100 rule
  • 4 business drivers for data governance
    4 business drivers for data governance
  • How can you quantify the ROI of your data governance investment?
    How can you quantify the ROI of your data governance investment?
  • The role of a data steward
    The role of a data steward
  • The Case for a Data Quality Dashboard
    The Case for a Data Quality Dashboard
  • 5 use cases that depend on data governance
    5 use cases that depend on data governance

RSS Upcoming events

  • An error has occurred; the feed is probably down. Try again later.

Connect on Facebook

Connect on Facebook

Follow us on Twitter

  • InfoReg’s patience with # POPIA violators is coming to an end ow.ly/t45I50JMquR #DataPrivacy 19 hours ago
  • Pretectum Thanks for following. Looking forward to interacting 2 days ago
  • How can you uses mobile movement data to understand large groups of consumers without abusing #privacy?… twitter.com/i/web/status/1… 3 days ago
  • Data management key to the digital transition of African Banks blog.masterdata.co.za/2022/06/28/dat… 3 days ago
  • Read how to target customer's more effectively using consumer behaviour data in this @PreciselyData blog post:… twitter.com/i/web/status/1… 4 days ago
Follow @mdm_za

Archives

Blog at WordPress.com.
Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
To find out more, including how to control cookies, see here: Cookie Policy
  • Follow Following
    • Data Quality Matters
    • Join 1,703 other followers
    • Already have a WordPress.com account? Log in now.
    • Data Quality Matters
    • Customize
    • Follow Following
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar
 

Loading Comments...