azure data factory - java.nio.BufferOverflowException

Jilova, Hristina 1

Hi, I'm using copy activity to copy ORC files from DL Gen 2 to Synapse. Some files are running fine but other files fail with this error:
What is the reason. I'm using : AutoResolveIntegrationRuntime

"errorCode": "2200",
"message": "ErrorCode=ParquetJavaInvocationException,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,
Message=An error occurred when invoking java,
message: java.nio.BufferOverflowException:Unable to retrieve Java exception..,
Source=Microsoft.DataTransfer.Richfile.OrcTransferPlugin,'
'Type=Microsoft.DataTransfer.Richfile.JniExt.JavaBridgeException,
Message=,Source=Microsoft.DataTransfer.Richfile.HiveOrcBridge,'",
"failureType": "UserError",
"target": "ttttttttttttttt",
"details": []

Thank you! Hristina

KranthiPakala-MSFT 46,602 Reputation points Microsoft Employee

2020-06-19T03:38:47.937+00:00
Hi @Jilova, Hristina ,

Welcome to Microsoft Q&A and thanks for reaching out.

To better assist on your query, could you please provide below additional information, which would help us to narrow down the root cause analysis..

What is the region of your data factory?

What is the region of your source-ADLS Gen2 & Sink-Synapse?

What is the latest failed pipeline run Id?

What is the latest failed activity run Id?

Could you please give a try with Self Hosted Integration Runtime and let us know if you still notice the same behavior/error?

Looking forward to your response.

----------

Thank you.

1 answer

Jilova, Hristina 1 Reputation point

2020-06-19T07:07:51.643+00:00

Hi, here is the requested info:

What is the region of your data factory? - Canada Central

What is the region of your source-ADLS Gen2 & Sink-Synapse? - Canada Central

What is the latest failed pipeline run Id? - 77011d75-a610-4c8b-95a2-a45031f737ae

What is the latest failed activity run Id? - 281d6dbb-faf1-408d-b8b9-35c1dc8e0017

Could you please give a try with Self Hosted Integration Runtime and let us know if you still notice the same behavior/error? - No, I cannot, I have no permissions to create Self Hosted Integration Runtime.
Please sign in to rate this answer.
KranthiPakala-MSFT 46,602 Reputation points Microsoft Employee

2020-06-22T17:03:19.037+00:00

Hi @Jilova, Hristina ,

Thanks for sharing the details. I am working with internal team to figure out the root cause of this issue. Will keep you posted as soon as I have an update.

KranthiPakala-MSFT 46,602 Reputation points Microsoft Employee

2020-06-23T16:25:44.147+00:00

Hi @Jilova, Hristina ,

After looking at the logs, it could be an issue with data and needs a deeper analysis on your source data. For deeper investigation and immediate assistance, If you have a support plan you may file a support ticket, else could you please send an email to AzCommunity@Microsoft.com with the below details, so that we can enable a one-time-free support for you to work closely on this matter.

Subject of the email: <Attn - Kranthi : Microsoft Q&A Thread title>

Thread URL: <Microsoft Q&A Thread link>

Subscription ID: <your subscription id>

Let me know here once you have done the same.

----------

Thanks

Joris 6 Reputation points

2020-07-01T09:33:47.167+00:00

Hi @KranthiPakala-MSFT,

I am trying to copy a ORC file from a data lake store gen1 to a data lake store gen 2 and get the same error:
{
"errorCode": "2200",
"message": "ErrorCode=ParquetJavaInvocationException,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=An error occurred when invoking java, message: java.nio.BufferOverflowException:Unable to retrieve Java exception..,Source=Microsoft.DataTransfer.Richfile.OrcTransferPlugin,''Type=Microsoft.DataTransfer.Richfile.JniExt.JavaBridgeException,Message=,Source=Microsoft.DataTransfer.Richfile.HiveOrcBridge,'",
"failureType": "UserError",
"target": "Copy data2",
"details": []
}

Any solutions for this questions?

KranthiPakala-MSFT 46,602 Reputation points Microsoft Employee

2020-07-08T21:41:26.303+00:00

Hi @JilovaHristina-1166 ,

Apologizes for delay in my response. A similar issue was reported by a different user and a support request has been filed. I have been closely monitoring that support request and will keep you posted once I have the outcome of the support request investigation.

Here is the similar issue reported: https://learn.microsoft.com/en-us/answers/questions/43594/index.html

Thank you for your patience.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

azure data factory - java.nio.BufferOverflowException

1 answer

Your answer