We have a storage account which has a container that sends files to our vendor. Issue we are facing with duplicate files being sent with the original files. How Do I check the root cause of this issue, also, trying to see where I can find the logs.

Question

We have a storage account which has a container that sends files to our vendor. Issue we are facing with duplicate files being sent with the original files. How Do I check the root cause of this issue, also, trying to see where I can find the logs.

your help and expertise will be of much help.

Thanks,

Jan

Answer 1

Hi @Jan A

Welcome to Microsoft Q&A Forum. Thanks for posting your query here!

To find the root cause of duplicate files being sent from your storage account container to your vendor, you can start by reviewing the logs associated with the upload process. The logs can provide insights into the operations performed on the files, including any actions that may result in duplicates being created.

Check the Log Analysis: Enable logging, if logging is not already enabled, you should set it up to capture relevant events related to file uploads and sends.

Check Azure Storage Logs for operations performed on the container. You can enable logging in the Azure portal. Please follow the guide here.

• Go to your storage account.
• Navigate to Diagnostics settings.
• Enable logging for Blob operations (Read, Write, Delete).

Custom Application Logs: Check if your application has custom logging, review those logs to see when files are being sent and if there are any error messages or retries.

Also, there are many tools for analyzing monitoring data: You can use Metrics explorer, Log Analytics, activity logs. Follow the document in order to setup the Analyze monitoring data Analyze monitoring data for your storage account and also you can find how to check logs for the storage accounts.

For Azure Data Box, you can locate the logs by following these steps:

1. Open your order in the Azure portal.
2. Check the Overview pane for the disk status and the paths to diagnostics logs for the disk.
3. The logs are uploaded to a container named databoxcopylog in your storage account. You can find the URLs for the logs in the format:
   • Copy log: <storage-account-name>/databoxcopylog/<order-name>_<device-serial-number>_CopyLog_<job-ID>.xml
   • Verbose log: <storage-account-name>/databoxcopylog/<order-name>_<device-serial-number>_VerboseLog_<job-ID>.xml

These logs will help you identify any errors or operations that may have led to the duplication of files.

Additionally, if you are using Azure Storage directly, you can check the server-side logs to see if there are any operations that indicate a file was uploaded multiple times or if there were any errors during the upload process.

Also, make sure if you are using an Azure Function, Logic App, or any other automated process to send files, check how and when these triggers are fired. Ensure that triggers are not being invoked more than once for the same event.

Set up monitoring and alerting on your storage account and application to notify you of unusual activity, such as multiple sends of the same file.

Use Azure Monitor or Application Insights to track the behavior of your application.

Hope this information helps.

Please let us know if you have any further queries. I’m happy to assist you further.

---

Please do consider "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.