In Data Lake Storage Account Gen 2 unexpected reduction of calls API "GetPathStatus" and "ListFilesystemDir"

Question

Hi,

I am reaching out with an inquiry regarding the transactions quantity in an data lake storage account gen 2 on Azure. We have noticed that starting on 28th october, the transactions quantity associated with storage account have significantly decreased from 50 millions per day to 18 millions per day. We would like to know if there is a specific reason behind this reduction because we didn't make any change on our part.

In an exploration trougth Monitor Insigths we found that the API Names with these reduction was "GetPathStatus" and "ListFilesystemDir".

 

We look forward to any additional information you can provide about the reason for this reduction.

Best regards

Answer 1

Hello Javier Coll Doñetz,

Greetings! Welcome to Microsoft Q&A Platform.

I understand that your Azure Data Lake storage account gen 2 transactions quantity on storage account have significantly decreased recently might be due to various reasons,

This might be related to optimizations or changes in the application or services interacting with the storage account and if there have been recent updates or improvements to the Azure Data Lake Storage Gen2 service, it might have led to more efficient processing, resulting in fewer transactions being required for the same operations.

Please refer - https://learn.microsoft.com/en-us/azure/storage/blobs/upgrade-to-data-lake-storage-gen2, https://learn.microsoft.com/en-us/azure/hdinsight/overview-data-lake-storage-gen2,https://learn.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-best-practices.

The low number of "GetPathStatus" and "ListFileSystemDir" operations in your data lake will optimize data layout by ensuring that your data is properly organized and partitioned in your data lake. This can help the number of metadata operations required for queries and improve the performance efficiently.

Please share error messages if you are encountering anything.

Hope this information helps! please let us know if you have any further queries. I’m happy to assist you further.

---

Please "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.