Granted Microsoft Purview SAMI permissions on the source - Contributor to the workspace In Purview, set up a Data Map: Collection, Connection and Scanned for assets In Data Catalog, created a Governance Domain , a Data Product with assets (1 Report, 1 Semantic Model) and a connector. Scheduled and scanned the data product The results from the scan of the assets in the data product were: "Skipped". No data quality information exists when checked. Data Quality Score: No score available Now, when I go into the data product, I cannot remove the data asset, the option to "remove" is grayed out. There is hint text over the grayed out option: "Remove data quality data before removing this data asset" How do I remove data quality data if the asset was skipped and no data quality data seems to exist??? There is a scan history for the data asset, but I don't see any option to delete that scan history through the interface. What's the process for removing data quality data for an asset published in a data product?

Remove data quality data before removing this data asset

James Brien 0

Granted Microsoft Purview SAMI permissions on the source - Contributor to the workspace

In Purview, set up a Data Map: Collection, Connection and Scanned for assets

In Data Catalog, created a Governance Domain , a Data Product with assets (1 Report, 1 Semantic Model) and a connector. Scheduled and scanned the data product

The results from the scan of the assets in the data product were: "Skipped". No data quality information exists when checked.

Data Quality Score: No score available

Now, when I go into the data product, I cannot remove the data asset, the option to "remove" is grayed out.

There is hint text over the grayed out option: "Remove data quality data before removing this data asset"

How do I remove data quality data if the asset was skipped and no data quality data seems to exist???

There is a scan history for the data asset, but I don't see any option to delete that scan history through the interface.

What's the process for removing data quality data for an asset published in a data product?

Ganesh Gurram 1,120 Reputation points Microsoft Vendor

2024-11-01T19:22:03.9933333+00:00

@James Brien - Thanks for the question and using MS Q&A platform.

Have you changed the default data asset type from Delta to Parquet before configuring the Data Quality scanning job?
Ganesh Gurram 1,120 Reputation points Microsoft Vendor

2024-11-01T19:32:27.2133333+00:00

@James Brien - For reference, here is the MS documentation: Configure and run data quality scan

As shown in the screenshot below, change the default data asset type delta to Parquet before configuring Data Quality scanning job.
James Brien 0 Reputation points

2024-11-01T21:44:12.71+00:00

When I go to Data Catalog > Health Management > Data Quality

Then I click on the Governance Domain > The Data Product

The assets are listed in the screen in the data product, but they are not "clickable" , I cannot enter the asset's health screen through the data product list of assets.

When I hover over the name of the asset, I see hint text that says:

"Usupported type, supported data sources and file format are documented here: Microsoft Purview Data Quality overview"
Ganesh Gurram 1,120 Reputation points Microsoft Vendor

2024-11-02T00:10:35.7833333+00:00
@James Brien - The error message clearly states that your data asset's file format is not currently supported for Data Quality assessments in Microsoft Purview.

Review the Microsoft Purview Data Quality overview documentation to verify which asset types and data sources are supported for data quality monitoring. If the assets in the data product are of unsupported types, this could explain why they are not clickable.

Below screenshot shows the supported file types for scanning, for schema extraction, and classification where applicable:

Make sure you must change the default data asset type delta to Parquet before configuring Data Quality scanning job.

Ensure that the data product is correctly configured. Sometimes, specific settings or configurations can limit functionality. Double-check the setup to ensure everything aligns with best practices.

Ensure that the user has the appropriate permissions to view and manage data quality settings for the assets. Sometimes, permissions can restrict access to certain features or views.

For more details refer to this documentation: Microsoft Purview Data Quality assessment scan | Microsoft Learn

Hope this helps. Do let us know if you have any further queries.
James Brien 0 Reputation points

2024-11-02T08:45:18.6733333+00:00

The goal is to remove this data product, not to configure it for proper scanning.

when I go into the data product, I cannot remove the data asset, the option to "remove" is grayed out.

There is hint text over the grayed out option: "Remove data quality data before removing this data asset"

How do I remove data quality data if the asset was skipped and no data quality data seems to exist???

The configuration may be incorrect, but it was allowed to happen.. Now there is a data product with assets that needs to be removed, but the system isn't allowing that to happen.
Ganesh Gurram 1,120 Reputation points Microsoft Vendor

2024-11-04T05:12:12.8+00:00
@James Brien - Thank you for providing more details about your issue. To remove the data product and its associated assets despite encountering the "Remove data quality data before removing this data asset" prompt, here are some troubleshooting steps that needs to be considered which might help you.

Verify Data Quality Information:

Navigate to the Data Quality pane and ensure that there are no residual data quality metrics or configurations tied to the assets. Since the assets were skipped and no data quality data seems to exist, this step is likely just to double-check.

Check for Hidden Dependencies:

Sometimes, dependencies or configurations that are not immediately visible in the interface can prevent deletion. Double-check any linked or dependent resources that might be causing the issue.

Delete previous data quality scans:

From Microsoft Purview Data Catalog, select the Health Management menu and Data quality submenu.

Select a governance domain from the list.

Select the ellipsis ('...') button at the top of the page.

Select Delete data quality data to delete the history of data quality runs.

For additional information, please refer: Delete previous data quality scans

I hope this information helps. Please do let us know if you have any further queries.
Ganesh Gurram 1,120 Reputation points Microsoft Vendor

2024-11-04T22:50:13.48+00:00

@James Brien - We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
James Brien 0 Reputation points

2024-11-05T15:46:44.7733333+00:00
The suggestions listed from the documentation are not working.

There is no way to delete the data product without first deleting the assets

There is no way to delete the asset without deleting dependent scan data

There is no way to delete the scan data because no scan data exists for the skipped asset.

A scan history exists, but in each one the assets the results were "skipped", options to delete the scans are not available, there is no health data

Verify Data Quality Information:

Navigate to the Data Quality pane and ensure that there are no residual data quality metrics or configurations tied to the assets. Since the assets were skipped and no data quality data seems to exist, this step is likely just to double-check.

In the Data Product pane, under the list of assets, none of assets listed are "clickable", so it is not possible to enter the Data Quality pane to delete the scan data.

When I hover over the name of the asset, I see hint text that says:

"Usupported type, supported data sources and file format are documented here: Microsoft Purview Data Quality overview"

Delete previous data quality scans:

From Microsoft Purview Data Catalog, select the Health Management menu and Data quality submenu.

Select a governance domain from the list.

Select the ellipsis ('...') button at the top of the page.

Select Delete data quality data to delete the history of data quality runs.

There is no ellipses available on the governance domain pane

As a workaround, I can view the asset scan results overview through the scan history in Monitoring

Data Catalog > Health Management > Data Quality

Click on the governance domain From the Manage drop down menu, choose Monitoring Choose a data asset to view the scan details Click on the data asset name to view the asset view pane

For the skipped asset, the links are disabled in the top of the overview screen

No scan data exists in the overview. For some reason it says there is no connection, but a connection was required before a scan was ever performed.
Ganesh Gurram 1,120 Reputation points Microsoft Vendor

2024-11-07T06:11:52.9133333+00:00

@James Brien - I agree that this issue looks strange, and I wasn't able to reproduce this issue. If you have a support plan, could you please file a support ticket for deeper investigation and do share the SR# with us?
Ganesh Gurram 1,120 Reputation points Microsoft Vendor

2024-11-07T22:59:47.1433333+00:00

@James Brien - Did you get a chance to raise a support ticket? If so, please share the SR number. Thanks

Share via

Remove data quality data before removing this data asset

Your answer