Data factory copy operation in immutable storage fails

Akshay Vithalkar 1

I have data factory with one pipeline which do copy operation from one container to another within same storage account. I have two containers "daily" and "weekly" and my pipeline copy files from daily to weekly.

When new files are coming into daily container, I need those files copied over to weekly. When I am running pipeline it is successfully copying files but it returing error

ErrorCode=UserErrorWriteFailedFileOperation,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The file operation is failed, upload file failed at path: 'weekly/2912025.txt'.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=Microsoft.WindowsAzure.Storage.StorageException,Message=The remote server returned an error: (409) Conflict.,Source=Microsoft.WindowsAzure.Storage,StorageExtendedMessage=This operation is not permitted as the blob is immutable due to a policy. Daily has retention policy to 1 and weekly has 7. What could be the issue.

Akshay Vithalkar 1 Reputation point

2025-01-29T13:06:06.6066667+00:00

I am not understanding why this thowing errors for new files. However, its copying it to destination with no issues. It just I am getting error.
Syed Aaqid Ali 260 Reputation points Microsoft External Staff

2025-01-29T16:42:14.98+00:00

Hi @Akshay Vithalkar

Greetings & Welcome to Microsoft Q&A forum! Thanks for posting your query!

Based on the error message you're seeing indicates that the blob you're trying to copy is immutable due to a policy. This means that the blob has a retention policy that prevents it from being modified or deleted until a certain period of time has passed.

For example, suppose that a user creates a time-based retention policy with a retention interval of five years. An existing blob in that container, testblob1, was created one year ago, so the effective retention period for testblob1 is four years. When a new blob, testblob2, is uploaded to the container, the effective retention period for testblob2 is five years from the time of its creation.

In your case, it seems that the blob you're trying to copy from the "daily" container to the "weekly" container has a retention policy of 1 day, which means it cannot be modified or deleted until at least 1 day has passed since it was created. This is why you're seeing the "409 Conflict" error when you try to modify the blob. To resolve this issue, you can either wait until the retention period has passed before copying the blob, or you can modify the retention policy to allow the blob to be modified or deleted sooner.

Kindly let me know if this is helpful!

Thanks.
Akshay Vithalkar 1 Reputation point

2025-01-30T09:18:53.18+00:00

but what about new blob,, when I am copying new file to destination its being copied successfully but pipeline showing error.
Syed Aaqid Ali 260 Reputation points Microsoft External Staff

2025-01-30T11:21:02.4866667+00:00

Hi Akshay,

Copy will be successful as it is a read operation at the Source container, kindly verify if you are making any other write operations after copying the blob from the source, for example delete or overwrite. I would highly appreciate you to check the ADF pipeline if its making any write operations as error message confirms that error message is for the failed write operation.

ErrorCode=UserErrorWriteFailedFileOperation,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The file operation is failed, upload file failed at path: 'weekly/2912025.txt'.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=Microsoft.WindowsAzure.Storage.StorageException,Message=The remote server returned an error: (409) .
Akshay Vithalkar 1 Reputation point

2025-02-03T09:47:25.2933333+00:00

weekly/2912025.txt was new file copied from daily, there was no file present before in weekly container. Still same issue.
Syed Aaqid Ali 260 Reputation points Microsoft External Staff

2025-02-03T16:55:55.2333333+00:00

Hi Akshay,

As I previously explained the cause of the error messages, to further investigate the root cause of these errors, I highly recommend enabling diagnostic settings within the same storage account and analyzing the corresponding logs.

Logs are stored as data in your account. Log data can accumulate in your account over time which can increase the cost of storage. If you need log data for only a small period of time, you can reduce your costs by modifying the data retention policy. Stale log data (data older than your retention policy) is deleted by the system. We recommend setting a retention policy based on how long you want to retain the log data for your account. See Billing on storage metrics for more information.

Reference:

Azure Storage analytics logging

Enable logs

Kindly let me know if this helps or require further help!
Syed Aaqid Ali 260 Reputation points Microsoft External Staff

2025-02-05T17:51:03.8233333+00:00

Hi Akshay,

I wanted to follow up and see if the given answer was helpful. If you have any more questions, please let us know.
Syed Aaqid Ali 260 Reputation points Microsoft External Staff

2025-02-10T19:02:34.9133333+00:00

Hello Akshay Vithalkar

Checking to see whether you have resolved the issue with the solution provided above, or if you need any further assistance, please let us know.

1 answer

Amrinder Singh 5,715 Reputation points Microsoft Employee

2025-03-05T16:50:24.32+00:00

Hi Akshay Vithalkar,

Thanks for reaching out over Q&A Forum.

When is comes to immutability, this is like a WORM state and there are certain operations that are restricted, It is quite possible that the pipeline is copying the file for the ver first time, which is succesful an immediately, it might be trying to set some kind of properties and that's where will be erroring out.

My recommendations is to enable diagnostic logging which shall help in identifying for which operation are you actuallly getting the error and if it is after blob gets copied.

https://learn.microsoft.com/en-us/azure/storage/blobs/monitor-blob-storage?tabs=azure-portal

Hope this helps! Please let us know do you have any further queries.

Please do consider to “up-vote” wherever the information provided helps you, this can be beneficial to other community members.
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

Data factory copy operation in immutable storage fails

1 answer

Your answer