Data quality improvement actions

Note

The Microsoft Purview Data Catalog is changing its name to Microsoft Purview Unified Catalog. All the features will stay the same. You'll see the name change when the new Microsoft Purview Data Governance experience is generally available in your region. Check the name in your region.

Quality of data is directly linked to the quality of decision making. Good quality data provides business process insights, better understanding of customers, and faster problem identification. Data quality actions identify problems that you should address to improve data quality in your data estate.

Required roles

Data quality action types

In current release, here are list of data quality actions the application is generating:

  • Rule has fallen below default thresholds
  • Global data quality score has fallen below threshold
  • data quality scanning and/or data quality profiling job has failed
  • data quality scanning and/or data quality profiling job has skipped due to no changes on data since last run
  • Outlier presence in profiled columns
  • Too many nulls in the profiled data asset

Data quality Actions severity

  • Action severity is High if data quality score is less than 25
  • Action severity is Medium if data quality score is less than 50
  • Action severity is Low if data quality score is less than 75

Data quality actions for governance domains

Data quality actions are rolled up from data asset level to the governance domain level. To browse these actions:

  1. From Microsoft Purview Data Catalog, select the Health Management menu and Data quality submenu.

  2. Select a governance domain from the list.

    Screenshot of the data quality page, with a governance domain selected.

  3. Select the Action button, to open the list of actions for the selected governance domain. (The button will be labeled something like, '6 action items', for example.)

    Screenshot of the list of data quality actions in the selected domain.

  4. Select an action from the list of actions.

  5. Assign the action to an individual to investigate and resolve. Recommendations and queries to find the low quality data are provided in the action details.

    Screenshot of a data quality action detail.

    Note

    Not every action will have a SQL query as not all actions are data related, or related to a data quality rule. Some actions are system related, for example: A data quality job has failed, a data quality job has skipped, etc.

  6. Update the status if needed, and Save to save your changes.

Data quality actions for data assets

Data quality actions for a data asset can be browsed and assigned to individuals from the data quality overview page:

  1. From Microsoft Purview Data Catalog, select the Health Management menu and Data quality submenu.

  2. Select a governance domain from the list.

  3. Select a data product from the list.

  4. Select a data asset from the assets attached to your data product.

  5. Select the View all link in the Actions tile to navigate the action list of the data asset.

    Screenshot of the data quality overview page, with assets selected.

  6. Browse through the list of Active, In progress, Resolved, and My items actions.

    Screenshot of the data quality actions for the selected asset.

  7. Select one of the actions to see the details and assign it to an individual for remedy. Recommendations and queries to find the low quality data are provided in the action details.

    Screenshot of the asset level action details.

    Note

    Not every action will have a SQL query as not all actions are data related, or related to a data quality rule. Some actions are system related, for example: A data quality job has failed, a data quality job has skipped, etc.

  8. Update the status if needed, and Save to save your changes.

Next steps