RunOperation encountered an exception and will retry. Exception: Azure.Messaging.ServiceBus.ServiceBusException: The operation did not complete within the allotted timeout of 00:00:59.9390000
Azure function - in consumption mode - connected to a session based queue randomly has this error
2025-03-13T03:30:52Z [Verbose] RunOperation encountered an exception and will retry.
Why is it randomly failing?
Exception: Azure.Messaging.ServiceBus.ServiceBusException: The operation did not complete within the allotted timeout of 00:00:59.9390000. The time allotted to this operation may have been a portion of a longer timeout. For more information on exception types and proper exception handling, please refer to https://aka.ms/ServiceBusExceptions . TrackingId:75faf82a-0798-4a77-8a20-6e1a06b84e8a_B2, SystemTracker:gi::G30:174347:amqps://recelpoc.servicebus.windows.net/-426dc526;0:5:6:source(address:/que-AteryxgDemo-ZFAfFf,filter:[com.microsoft:session-filter:]), bi::in-connection1166164(G30-12155)::session1166165::link1287914, Timestamp:2025-03-13T03:30:52 TrackingId:149a2cd10ed145db84c46309d89516b1_G30, SystemTracker:gateway10, Timestamp:2025-03-13T03:30:52 (ServiceTimeout). For troubleshooting information, see https://aka.ms/azsdk/net/servicebus/exceptions/troubleshoot.
2025-03-13T03:30:53Z [Information] Request [d949bdad-a2d9-45ee-918d-e3f79e359a24] HEAD https://recelpocenv86d7.blob.core.windows.net/azure-webjobs-hosts/locks/azfn-ateryjk-rxgnxo/host
x-ms-version:2023-11-03
Accept:application/xml
x-ms-client-request-id:d949bdad-a2d9-45ee-918d-e3f79e359a24
x-ms-return-client-request-id:true
User-Agent:azsdk-net-Storage.Blobs/12.19.1 (.NET 8.0.12; Debian GNU/Linux 11 (bullseye))
x-ms-date:Thu, 13 Mar 2025 03:30:52 GMT
Authorization:REDACTED
client assembly: Azure.Storage.Blobs
2025-03-13T03:30:53Z [Information] Response [d949bdad-a2d9-45ee-918d-e3f79e359a24] 200 OK (00.0s)
Accept-Ranges:bytes
ETag:"0x8DD61DE0A0FEC53"
Server:Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0
x-ms-request-id:c2455b70-c01e-006d-4fc8-93b5b1000000
x-ms-client-request-id:d949bdad-a2d9-45ee-918d-e3f79e359a24
x-ms-version:2023-11-03
x-ms-meta-FunctionInstance:REDACTED
x-ms-creation-time:Wed, 10 Jul 2024 20:38:51 GMT
x-ms-lease-status:locked
x-ms-lease-state:leased
x-ms-lease-duration:fixed
x-ms-blob-type:BlockBlob
x-ms-server-encrypted:true
Date:Thu, 13 Mar 2025 03:30:51 GMT
Content-Length:0
Content-Type:application/octet-stream
Content-MD5:1B2M2Y8AsgTpgAmY7PhCfg==
Last-Modified:Thu, 13 Mar 2025 03:20:43 GMT
2025-03-13T03:30:54Z [Information] Creating receive link for Identifier: que-AteryxgDemo-ZFAfFf-da6d57df-1000-45ac-ae9a-a13d5e2832d7.
2025-03-13T03:30:54Z [Verbose] que-AteryxgDemo-ZFAfFf-da6d57df-1000-45ac-ae9a-a13d5e2832d7: Requesting authorization to amqps://recelpoc.servicebus.windows.net/que-AteryxgDemo-ZFAfFf
2025-03-13T03:30:54Z [Verbose] que-AteryxgDemo-ZFAfFf-da6d57df-1000-45ac-ae9a-a13d5e2832d7: Authorization to amqps://recelpoc.servicebus.windows.net/que-AteryxgDemo-ZFAfFf complete. Expiration time: 03/13/2025 03:59:51
2025-03-13T03:30:54Z [Information] Request [003b946f-8a41-4dd6-a12c-cf05024cf662] HEAD https://recelpocenv86d7.blob.core.windows.net/azure-webjobs-hosts/locks/azfn-ateryjk-rxgnxo/host
x-ms-version:2023-11-03
Accept:application/xml
x-ms-client-request-id:003b946f-8a41-4dd6-a12c-cf05024cf662
x-ms-return-client-request-id:true
User-Agent:azsdk-net-Storage.Blobs/12.19.1 (.NET 8.0.12; Debian GNU/Linux 11 (bullseye))
x-ms-date:Thu, 13 Mar 2025 03:30:53 GMT
Authorization:REDACTED
client assembly: Azure.Storage.Blobs
2025-03-13T03:30:54Z [Information] Response [003b946f-8a41-4dd6-a12c-cf05024cf662] 200 OK (00.0s)