Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,186 questions
Azure synapse spark start-up fail: CLUSTER_CREATION_TIMED_OUT: Livy session has failed.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(230.39999999999998, 24%, 32%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EPT%3C/text%3E%3C/svg%3E)
Pieter Tjerkstra
5
Reputation points
Since a few days none of my spark pools in Azure synapse analytics are able to start-up. After trying for 15 minutes to start, I either get this message:
LivySessionCreationTimeoutException: Livy session creation timed out. workspace: we-psch-a-data-syn, pool: wepschdatasprk, session id: 70
Or this message:
CLUSTER_CREATION_TIMED_OUT: Livy session has failed. Session state: Error. Error code: CLUSTER_CREATION_TIMED_OUT.
[plugins.we-psch-a-data-syn.wepschdatasprk.68 WorkspaceType:<Synapse> CCID:<779e0f73-8ced-4cf1-9fd2-abeb7ba5f8fd>]
Attempt=[1]/[3]Cluster was in terminal state=[Cancelled] before it reached 'Ready' state.
Cluster job has WorkspaceName=[we-psch-a-data-syn], SpecName=[wepschdatasprk], and JobId=[85479d1c-eb62-4fb2-bbe3-728791426c4c]. Source: Dependency.
Do you have any clues how to solve this?
I tried different cluster sizes, a new spark pool and a new infrastructure release.
{count} vote
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(28.799999999999997, 41%, 12%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVC%3C/text%3E%3C/svg%3E)
Victor Chu 0 Reputation points2025-02-13T10:54:34.0566667+00:00 I've faced the similar issue when I try to start the spark pool with the notebook today with the following error: **InvalidHttpRequestToLivy: HTTP status code: 400.**The pool that fail to start are using spark version 3.2. I have tried to use another spark pool with spark version 3.3 which is able to start without any issue. Was wondering would it be due to the spark version?
What spark version are you using?
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu 20,285 Reputation points Microsoft Vendor2025-02-14T11:29:57.18+00:00 @Pieter Tjerkstra Have you tried the suggestion provided by @Victor Chu ? If not, please let us know, and we will assist you with the issue you are facing.
Sign in to comment
Sign in to answer