This post was first published by Infogix, on their blog, and is reposted with permission
In recent years, organizations have grown more aware of their data and the role it plays in the success or failure of their most critical business operations. Technology disruptions such as Internet of Things (IoT), connected devices, mobility, cloud computing and digitalization have increased the flow of data making “data everywhere” a new normal. More data and the availability of cheaper storage that supports emerging technology like big data computing has only pushed organizations to store virtually everything. Unfortunately, this mantra has resulted in inconsistent parameters around mission critical, vital and sensitive data points, in many cases, leading to the creation of data swamps full of dark data.
Today, organizations are struggling with the overall governance and movement strategies of critical operational data. The move towards a consolidated master data set from silo-ed data environments is something many are considering and trying to implement. The goal of such master data programs, or Master Data Management (MDM) initiatives, is to identify, validate and resolve data issues as close to the source as possible, as well as create a “golden copy” of critical enterprise data for consumption. A successful MDM program ensures data consistency, completeness, and accuracy, but simply implementing an MDM program by itself cannot ensure success unless business supported data management programs are run in parallel:
- Strategic Planning & Data Governance: Determine and document policies and procedures to understand key points: What does the data mean? Where does the data come from? How do I find the data I need? Who owns the data?
- Data Quality Management: Continuous data improvement and data quality initiatives to ensure dimensions of completeness and accuracy across critical enterprise data answering the question “Can I trust the data?”
- Business and Metadata Management: Data programs that create data awareness for end users such as building business glossaries and/or data/metadata dictionaries.
MDM: Success Factors
Gartner indicates that only 33% of MDM programs will succeed in demonstrating value to the organization. MDM programs without a data management strategy are most likely moving data with redundancy. This is a prescription for failure. Consolidating critical data points across different application environments like CRMs, ERPs and other core system applications, etc. is very complex because many applications share common data points, but they are not related through enforced data model layers.
Therefore, implementing an MDM program is not as easy as downloading a new piece of software. It’s a process that requires many steps. But before implementing an MDM program, it’s important to identify and address the following key success factors:
- End User Buy-In: When starting the program, it’s important that scope and objectives are created with the end user’s buy-in. As a business-driven, IT-enabled program, MDM helps business own the data and ownership of the outcomes. Most MDM outcomes are expected to improve business process management program efficiency or redefine existing business process. Expecting business teams to accept new changes without business buy-in is one of the most common causes of MDM failures.
- Data Classification and Policies: Data may be classified many ways based on both internal and external policies. In recent years, with far-reaching regulations such as BCBS 239, GDPR and MIFID II, the need to classify critical or personal data, understand policy, usage, access, and distribution rights have come to light, with increased fines, financial, and reputational risks for lack of compliance.
- Golden Source Rule: The ability to establish authority of the data source using clear business objectives that are verifiable to prove the data origin. This also includes data ownership that defines when and how the data from the source can be re-written or changed and who can change it.
- Data Catalog/Inventory: Most MDM programs start with a small data set like customers or geography. As they incrementally expand, it becomes more difficult and complex to address multi-domain MDM without proper data cataloging or inventory. To do so, business users leverage data catalogs to identify and use the right sets of master data for decisions.
- Enterprise Data Quality: Can you trust your data? Data quality needs to address end user challenges that are more subjective in nature such as data believability, data trustworthiness, data provenance, etc.
- Data Ownership: Identifying who owns the data has to occur before an MDM program is rolled out. Once the data custodian is identified, that individual then has to identify and bless all required rules and policies to ensure MDM success.
- Measurable outcomes: MDM programs usually propel business process changes within the user Before implementing your MDM program, it’s important to benchmark business efficiency and then measure incremental benefits achieved by the business team post implementation.
The success of the above requirements is contingent upon solid data management and data governance programs. Tools and technology can help address any of the areas above that might be main points rather than success points. Ideally, organizations want to find an easy-to-manage, single solution that can be implemented quickly in a cloud environment, while complimenting core MDM tools.
Post MDM Implementation Concerns
After a successful MDM implementation, the work isn’t over. Like other implementations, the work is only beginning. You can’t set it and forget. Issues will arise and identified above is a list of the most common in an MDM implementation. Don’t say you weren’t warned. Learn from these experiences and make a concerted effort to ensure failure doesn’t haunt you at every turn.
- Perception of Data Trustworthiness: If users fail to recognize MDM as the golden source and instead, look up another source for their data needs, not only can they burden the system with bad data, they make the MDM program investment redundant.
- Data Quality Issues: MDM initiatives and data quality are intimately linked. Missing data or non-standard data are two common data quality challenges that you see in MDM programs. The root cause seems to originate from the identified authoritative source that might have some data anomalies, while other complimenting sources have the information that can fill in the gap. Most of the time it’s due to rigid MDM source hierarchy rules, resulting in missed opportunities to augment the right information from non-authoritative sources, eventually leading to more work by stewards.
- Dynamic Data Metrics: As the MDM program grows to a multi-domain objective, just providing metadata capabilities alone might not help user acceptance of the MDM data set. Adding data metrics such as volume or date range information may help users understand the volatility of the data. Other factors like frequency of the data occurrence at golden source and frequency of the changes on master data points are some critical factors that can provide users with much-required insight that would guide better data usage.
- Leveraging Transactional Controls & Analysis: As noted earlier, a successful MDM program has to be done in conjunction with solid data management and data governance programs. Automated controls provide capabilities such as multi-point reconciliation that can be deployed across multiple source systems. They then feed your MDM application and reconcile data differences by generating dynamic reconciliation reports that help both SME and MDM architects to adjust the data in applications to be in line with the enterprise master data source. While not all controls are the same, it’s critical to find those that can be deployed in any environment and can access any source to work within the data flow process without interference. The controls are meant to monitor and capture data metrics that can help dissect the process metrics and data quality metrics around the MDM data. Such information can be of great aid to information architects to continually improve the MDM value.