Data Profiling and Improved Data Quality

Mission Statement

A multinational Bank needed to improve its data quality in order to reduce its risk rating with regulators in their jurisdictions. To do this they needed to demonstrate the lineage of their data, where it was incomplete or not standardised, and their processes for prompt remediation.

Continuum was engaged to develop and deploy a “Data Profiling” application in Alteryx Designer.

Tools Used

Alteryx

- Alteryx Designer

Detailed Solution

The list of 380+ data warehouse fields to be validated, and their conformity rules, are stored in a secured Excel workbook for easy maintenance by the Bank’s team.

• Alteryx dynamically builds SQL statements that are executed against the data warehouse to return the data.

• Dynamic profiling expressions then determine a Pass/Fail flag for each record for Completeness and Conformity.

• PDF based dashboards showing Completeness/Conformity results over time are generated for management showing progress and compliance.

• “Raw” results data is output for analysis and remediation by the data teams.

• This high-profile project was able to be completed on a very short timescale by using Alteryx’s code-free ability to dynamically query and evaluate data.