How to connect to on-prem Analysis server using synapse notebook and uses System assigned managed identity as authentication.
HI Team, I have an on-prem analysis server details like server name and data base name managed by another team, they have provided access to me on the server but now is it possible to use a synapse notebook to connect to on prem analysis svr. Using…
How to connect to on-prem Analysis server using synapse notebook and uses System assigned managed identity as authentication.
HI Team, I have an on-prem analysis server details like server name and data base name managed by another team, they have provided access to me on the server but now is it possible to use a synapse notebook to connect to on prem analysis svr. Using…
How to fix 'Couldn't interpret '0000-07-01' as a valid DateTime' Error in copy activity - synapse analytics pipeline
Hello, Synapse analytics-copy data activity returning below error. But in my case many rows are having "0000-07-01" date in the DB table column. I have tried to change the datatype then to debug. But failed to copy. And then I tried copy…
Partitioned parquet file into an Azure Database
I inserted a parquet file into an Azure database and it had low throughput so I thought if I partitioned the file I could load the partitions in parallel. I partitioned the file on DefaultRating using pyspark and tried to insert but I'm not getting the…
Why is ORDER BY not supported when using CREATE EXTERNAL TABLE AS SELECT in azure synapse?
Hi there, We want to use ORDER BY when creating external table in azure synapse, somehow the ORDER BY does not take effect, may I ask why ORDER BY is not supported when using CREATE EXTERNAL TABLE AS SELECT in azure synapse?
Error on Sink in ADLS Gen2 Data Load: 'Operation Failed Due to Remote Host Connection Reset' - How to Resolve?
Hello, we are experiencing the error below in some Pipelines, when running the trigger schedule the following error appears: Operation on target Load Programacao_Producao_full failed: Failure happened on 'Sink' side.…
Unable to query deltalake file in Azure synapse
I have created a synapse link for dataverse for F&O data but when I tried query deltalake file it is throwing the error "Content of directory on path…
Permissions error in SSMS with a dataverse datalake
Hello, I'm having an issue with creating a PowerBI report - specifically connecting to a data source. I created a view in a datalake in SSMS based on dataverse data but keep experiencing this issue. My colleague cannot replicate the error and I'm not…
Datetime2 error when querying parquet file produced from Synapse copy activity from OData Business Central Source (data seems to be changed from 0001-01-01 to 0000-12-30)
I have a pipeline running a copy activity to copy data from Business Central OData source to parquet file everyday. Everything works fine before 16/07/2024 but problem arises starting from 17/07/2024. The parquet file no longer be able to query from…
Unable to delete Azure Synapse Workspace even through Powershell force deletion
Hello Team, I am unable to delete synapse analytics even though following up post through webUI or powershell. I tried following the steps mentioned in the link below :-…
Azure Synapse too slow to Open and work on Workspace
Hello- When loading and accessing Synapse workspace is taking a long time. Even it opens up after 20 mins - working around the workspace is very slow. There have been no changes/setting up. The health status looks fine. All env within that subscription…
Identifying Unused Tables in AAS Cube Over the Last 30 Days
I have a question regarding identifying unused tables in Azure Analysis Services (AAS). In our organization, we’re using AAS, and due to limited storage, our cube refresh is failing. I’ve been tasked with finding a list of tables that haven’t been used…
Data flow sink file name enumeration with LPAD function
Hi, when using a data flow to move data from one container to another and specify the output file names, I am able to get my files enumerated in the style of FileName1.csv, FileName2.csv...but I am not able to get this working with an lpad function.…
Filter email alerts to only receive failed provisioning logs for a specific Azure AD Enterprise Application
I'm trying to set up email alerts in Azure so that I only receive notifications for failed provisioning jobs related to a specific Azure AD Enterprise Application. Currently, I'm receiving additional alerts for provisioning jobs of other applications,…
Unable to see the spark pool I have created while configuring the synapse link for dataverse
I have created a spark pool in my synapse workspace to use it for the delta conversion during configuring the synapse link for dataverse for the D365FO data , unfortunately once I choose the synapse workspace and enabled "Use spark pool for delta…
Apache spark pool 3.3 deprecating but synapse link for dataverse is only supporting 3.3 version
I am trying to create a synapse link for dataverse for the D365FO data export , since the delta lake conversion is mandatory for F&O data I have tried creating a apache spark pool 3.4 version in synapse but it was not showing in the drop down while…
Request Timeout on ADF Web Activity to Synapse
Hello everyone! I have a set of pipelines in Azure Data Factory (ADF) that trigger Synapse via a Web activity POST request. This setup worked until today around 11 AM CET, but now it’s throwing the following error: Error calling the endpoint. Response…
Timeout error due to Error reading SSH protocol banner
Hi Team, We are facing ‘Timeout error due to Error reading SSH protocol banner’ while trying to connect to sftp server through Azure Synapse Notebook. We are using python as source language and paramiko version 2.12.0 to connect to the server and…
How to save complete web activity output to ADLS Gen2 in JSON format? Azure Synapse Studio
I want to save the output of my Web activity (which hits an Api and then fetches data from that Api in Json format) into blob storage account container. Also, my web activity is within a foreach - so multiple Api links are being hit and multiple files…
How to connect to Function App(Azure Functions) from Azure Synapse Studio
I want to connect my function app through Synapse studio but cannot seem to figure out the configurations. Here is my function.json and function definition along with Synapse configurations. My synapse pipeline basically takes the output of the web…