Hey,
I am trying to get Azure Fabric Notebook to work with VS Code using the Synapse Visual Studio Code Extension as described in: https://learn.microsoft.com/en-us/fabric/data-engineering/setup-vs-code-extension
I managed to install the prerequisites, my Java -version and conda --version both show that the path settings are set correctly. I installed the Synapse VS Code extension is VS Code. When launching VS Code I see the "fabric-synapse-runtime-1-1" and "fabric-synapse-runtime-1-2" are both created.
When I try to run a simple cell I get the message:
# Load Data from LH
df = spark.sql("SELECT * FROM TestLH.test")
---------------------------------------------------------------------------
AttributeError Traceback (most recent call last)
Cell In[1], line 2
1 # Load Data from LH
----> 2 afas_df = spark.sql("SELECT * FROM TestLH.test")
AttributeError: 'NoneType' object has no attribute 'sql'
I have tried to install the package "pyspark" to see if it would resolve the issue, but it did not fix anything. When checking the logs of the notebook I see the following Error, besides a lot of Info messages:
10:43:57,960 root ERROR Failed to initialize Spark Lighter variables. Create session failed {'code': 'InternalError', 'subCode': 0, 'message': 'An internal error occurred.', 'timeStamp': '2024-08-02T08:43:57.1685726Z', 'httpStatusCode': 500, 'hresult': -2147467259, 'details': [{'code': 'RootActivityId', 'message': '9cf56fb4-67f6-425a-a43d-aeaad0768bca'}, {'code': 'Param1', 'message': 'Response status code does not indicate success: 430 ().'}]}
Can anyone of you perhaps give me some advice to fix my issue of not being able to run my cell? Thanks in advance!