Purview Self-serve analytics does not upload the data to storage

Radosław Kamiński 0

Hello,

I have a problem with self-serve analytics setup in Purview. I configured this feature to export the data to ADLS Storage Gen2 (Settings -> Unified catalog -> Solution integrations). Connection test is successfull, managed identity that I'm using has a Storage Blob Data Contributor role assigned but no data is exported and storage remains empty.

I'm not able to see any errors or logs in purview and there is no notification that the data export failed.

Does any know how to make this work?

Chandra Boorla 7,335 Reputation points Microsoft Vendor

2025-01-13T18:29:29.0533333+00:00

Hi @Radosław Kamiński

Greetings & Welcome to Microsoft Q&A forum! Thanks for posting your query!

Kindly refer to the similar thread, which may provide valuable insights.

https://learn.microsoft.com/en-us/answers/questions/964381/microsoft-purview-data-lake-gen2-scan-failes-to-di

For more details, please refer: Connect to Azure Data Lake Storage in Microsoft Purview

Kindly consider upvoting the comment if the information provided is helpful. This can assist other community members in resolving similar issues.

I hope this information helps.

Thank you.
Radosław Kamiński 0 Reputation points

2025-01-14T08:01:35.1733333+00:00

Hi @Chandra Boorla

Thank you for your reply but it does not solve my problem. I do not have any issues with scanning ADLS in Purview. All configured scans work fine.

The problem is related to a different feature called 'Solution integrations'. Purview can export domain model and data into Fabric or Storage account and allow me to analyse the data using my own tools. You can read more about it here - https://learn.microsoft.com/en-us/purview/purview-dg-self-service-analytics-and-insight

I configured it as described in the documentation but unfortunately it doesn't work.
Chandra Boorla 7,335 Reputation points Microsoft Vendor

2025-01-16T02:36:23.8333333+00:00

@Radosław Kamiński

Thanks for clarifying, It sounds like you have configured the Self-serve Analytics feature in Microsoft Purview correctly, but the data export to your ADLS Gen2 storage is not functioning as expected. Here are some steps and considerations that may help you resolve the issue:

Check Configuration Settings - Double-check the configuration settings in Purview, Go to Settings -> Unified catalog -> Solution integrations and ensure that all settings are correctly configured. Make sure that the destination path in ADLS is correctly specified and accessible.

Review Logs and Monitoring - Although you mentioned not seeing any errors or logs, consider, enabling diagnostic logging for Purview to capture more detailed information about the operations. Checking Azure Monitor or Application Insights for any related logs that might provide insights into the issue.

Test Connectivity - Since the connection test is successful, consider performing a manual test, try uploading a small file directly to the ADLS Storage Gen2 using the same managed identity to ensure that it has the necessary access.

Please refer Share Azure Storage data in-place with Microsoft Purview Data Sharing (preview) for some valuable insights.

I hope this information helps. If the issue still persists, please do let us know.

Thank you.
Chandra Boorla 7,335 Reputation points Microsoft Vendor

2025-01-16T20:43:19.4166667+00:00

@Radosław Kamiński

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Kindly consider upvoting the comment if the information provided is helpful. This can assist other community members in resolving similar issues.

Thank you.
Radosław Kamiński 0 Reputation points

2025-01-17T09:51:19.47+00:00

@Chandra Boorla

I executed all steps from your previous post but the problem still exists. I created a new ADLS storage (with public network access enabled) and changed the configuration in purview to export data there. All permissions for managed identity are set correctly, connectitvity test passed, I can upload files manually as well. Configuration in Purview is saved - I waited 24 hours, but no files were exported to storage.
Radosław Kamiński 0 Reputation points

2025-01-17T10:51:31.8+00:00

@Chandra Boorla

I executed all steps from your previous post but the problem still exists. I created a new ADLS storage (with public network access enabled) and changed the configuration in purview to export data there. All permissions for managed identity are set correctly, connectitvity test passed, I can upload files manually as well. Configuration in Purview is saved - I waited 24 hours, but no files were exported to storage.
Chandra Boorla 7,335 Reputation points Microsoft Vendor

2025-01-21T20:48:18.13+00:00

@Radosław Kamiński

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Chandra Boorla 7,335 Reputation points Microsoft Vendor

2025-01-22T21:49:09.0633333+00:00

@Radosław Kamiński

Following up to see on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution, please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

1 answer

Chandra Boorla 7,335 Reputation points Microsoft Vendor

2025-01-20T19:50:02.8533333+00:00

@Radosław Kamiński

Thank you for providing the additional details. Since you've followed all steps, including creating a new ADLS storage account with public network access enabled, and still face issues with data export from Purview, here are some additional steps to consider:

Verify Storage Account Configuration - Ensure that the new ADLS storage account is correctly configured to allow exports from Purview. Check if there are any specific policies or restrictions applied at the container level that might prevent data from being written.

Check Purview Export Jobs - Navigate to Monitoring > Export Jobs in Purview to see if there are any active or failed jobs related to the export. This will give insights into why data is not being exported.

Azure Monitor and Logs Analysis - Use Azure Monitor and review the logs for any anomalies or errors related to data export from Purview. Ensure there are no network or permission-related errors.

Purview Version and Updates - Ensure that both Purview and the underlying services (e.g., Azure Data Lake Storage) are up-to-date. Sometimes, updating Purview or any dependent services might resolve persistent issues.

Retry with Different Settings - Try changing the storage container or the destination path once again. Sometimes, a fresh configuration with minor adjustments can resolve export issues.

I hope this information helps, please do let us know if you have any further queries.

Kindly consider upvoting the comment if the information provided is helpful. This can assist other community members in resolving similar issues.

Thank you.
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Purview Self-serve analytics does not upload the data to storage

1 answer

Your answer