Data Quality issue in the Purview

Question

Hello Team,

We have configured the ADLS2 as source and scan it. For the data Quality, we did the following the steps :

1. Create the Governance domain and publish it.
2. Create the Data Product and add the tables.
3. In the Data Quality section, add the connect and apply the Quality rules. However, we are getting the below error:

    **Max Retry Count Reached. Ending Workflow. Current Task HandleError**
   

4. while doing the profiling, we are getting this error : Unable to submit job to PFS with exception: Unable to submit job to Pfs Service.

Could you please take a look and help with this issue.

Thanks & Regards,

Dhaval Pujara

Answer 1

@Dhaval Pujara

Apologies for the inconvenience.

The errors you are encountering during the Data Quality process in Microsoft Purview could be due to several reasons:

Max Retry Count Reached:

• This error typically indicates that the system has attempted to process a task multiple times but has failed each time. This can happen if there are issues with the data format or if the data source is not accessible. Ensure that the data in your ADLS2 is in the correct format and that the connection to the data source is properly configured.

Unable to submit job to PFS:

• This error suggests that there may be a problem with the service responsible for processing the job. It could be related to the configuration of your data source connection or issues with the underlying service. Make sure that your connection settings are correct and that the necessary permissions are granted.

To troubleshoot these issues, please consider the following:

• Ensure that the data in your tables is in the correct format and that all required configurations have been completed.
• Verify that the Microsoft Purview Managed Identity (MSI) has the necessary permissions to access the data source.

Reference: Data quality troubleshooting

I hope this information helps, please do let us know if you have any further queries.

Thank you.