GetMetadat Activity returns False even if folder exists

Question

I have enabled GetMetadata Activity to check any folder/files existing in a Blob Storage. The Exists property which was working earlier isn't functioning as expected as observed this week and returns False even if a folder exists in the path.

Answer 1

@Sambit Sourav

Greetings & Welcome to Microsoft Q&A forum! Thanks for posting your query!

As I understand that you are experiencing an issue with the Get Metadata activity returning False for the exists property, even though the folder exists in Blob Storage. This issue can arise due to several factors. Here are some troubleshooting steps that might help you in resolving the issue.

Check Permissions - Ensure that the Get Metadata Activity has the necessary permissions (LIST/EXECUTE) for the specified folder in Blob Storage. Lack of permissions can prevent access and result in a False return.

Verify Folder Path/Recent Changes - Double-check the folder path specified in your dataset. A small typo or incorrect path can lead to the activity not finding the folder. If there have been any recent changes to the folder (like renaming or moving), this could affect the activity's ability to locate it.

Check Azure Status - Occasionally, there may be temporary issues with Azure services. You can check the Azure status page for any ongoing incidents that might be affecting the Get Metadata Activity.

Test with Different Paths - If possible, try using a different folder path or a known existing file to see if the issue persists.

Enable Logging - Consider enabling logging for the activity to capture detailed error messages, which can provide more insight into what might be going wrong.

Retry Activity - Although less likely given that it was previously working, implementing a retry mechanism with a short delay in your pipeline could help address potential transient issues.

I hope this information helps. Please do let us know if you have any further queries.

Kindly consider upvoting the comment if the information provided is helpful. This can assist other community members in resolving similar issues.

Thank you.