Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,335 questions
Error while Unzipping .tar.gz files using Copy activity - Failing for csv file having 8GB of data
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 21%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ENA%3C/text%3E%3C/svg%3E)
Nagarajan Arumugam
0
Reputation points
Hi,
I am trying to uncompress .tar.gz files using Copy Activity and it was working fine till yesterday. Today we have received a file with more data and it got failed while copying one file with 8GB of data with following error "ErrorCode=UserErrorWriteFailedFileOperation,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The file operation is failed, upload file failed at path: 'xxx-xx/yy/zzz/Test/251963-20250310-0000-F '.,Source=Microsoft.DataTransfer.Common,''Type=ICSharpCode.SharpZipLib.Tar.TarException,Message=Header checksum is invalid,Source=ICSharpCode.SharpZipLib,'".
Note : .tar.gz file contents multiple csv file data. We are unzipping and copying to further layer in our data lake.,
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(195.2, 50%, 28%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVR%3C/text%3E%3C/svg%3E)
Venkat Reddy Navari 80 Reputation points Microsoft External Staff2025-03-11T17:50:22.41+00:00 It looks like you're encountering an issue while trying to uncompress an 8GB.
tar.gzfile using the Copy Activity in Azure Data Factory. The error indicates achecksumissue with the file's header, which can be caused by several factors.- Verify the file integrity to ensure the
.tar.gzfile isn’t corrupted. You can check the file’s integrity or compare it with the source file if possible. If needed, attempt to download or transfer the file again from the original source. - Ensure there is enough disk space in the destination where you're attempting to uncompress and transfer the files. A lack of available space could lead to the operation failing.
- Try testing with smaller files to determine if the issue is related to the 8GB file. If the smaller files work without issues, then the size of the file might be a contributing factor.
- If the issue persists, you might want to try extracting the files manually using tools like
tarorgzipbefore uploading them to your data lake. This can help you identify whether the issue is with Azure Data Factory or the file itself. - Verify that the.
tar.gzfile is correctly structured and includes valid CSV files, as any formatting issues could lead to thechecksumerror. Take a look at the logs for any other error messages or information that might provide more insight into the issue.
I hope this helps. Please let us know if you have any further questions.
Kindly consider upvoting the comment if the information provided is helpful. This can assist other community members in resolving similar issues.
- Verify the file integrity to ensure the
-
Venkat Reddy Navari 80 Reputation points Microsoft External Staff
2025-03-12T09:15:55.23+00:00 @Nagarajan Arumugam
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Sign in to comment
Sign in to answer