5,012 questions with Azure Synapse Analytics tags

Sort by: Updated
0 answers

How to find empty folder and empty files by using synapse

Hi, How can I find if there are empty folder or files in gen2 container by using synapse? Either sql or notebook python. Thanks!

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,012 questions
asked 2024-11-19T19:55:50.79+00:00
Zhu, Yueli YZ [NC] 255 Reputation points
commented 2024-11-21T13:09:31.3633333+00:00
Ganesh Gurram 1,510 Reputation points Microsoft Vendor
1 answer

How to use Dynamic add content in Compression type in copy activity

Hi ,  I created the dynamic dataset and linker service. In copy activity i used that dynamic dataset and want to pass parameter in copy activity or use Compression type option as parameter/Dynamic when i click on Compression type there is drop down menu…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,012 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,908 questions
asked 2024-11-20T20:55:07.4966667+00:00
Junaid Bilal 0 Reputation points
answered 2024-11-21T12:31:42.7333333+00:00
Nandan Hegde 32,651 Reputation points MVP
1 answer

Synapse analytics Managed Identity authentication issue

Last year when my team tried to authenticate to dataverse from synapse workspace using managed identity, we hit an issue because we were not able to attach the synapse workspace managed identity (MSI) to the inner spark pool. With the SFIs requiring…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,012 questions
Microsoft Dataverse Training
Microsoft Dataverse Training
Microsoft Dataverse: A Microsoft service that enables secure storage and management of data used by business apps. Previously known as Common Data Service.Training: Instruction to develop new skills.
38 questions
asked 2024-11-20T01:20:56.6133333+00:00
Ashvini Krishna Ayyasamy 0 Reputation points Microsoft Employee
commented 2024-11-21T09:47:55.37+00:00
Smaran Thoomu 17,520 Reputation points Microsoft Vendor
1 answer

how to fix dedicated sql pool in azure synapse analytics

Started executing query at Line 1 Database 'hj' on server 'resourcesynnapse3' is not currently available. Please retry the connection later. If the problem persists, contact customer support, and provide them the session tracing ID of…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,012 questions
asked 2024-11-18T21:22:41.15+00:00
Elham Yadollahifarsi 0 Reputation points
commented 2024-11-21T09:05:42.2533333+00:00
Chandra Boorla 3,460 Reputation points Microsoft Vendor
1 answer

Need to automate a Synapse Analytics Pipeline to gather the information from the previous day. every day

I have a Synapse Analytics Pipeline that gather information from SharePoint and put it into a storage account container in Azure. It is a Copy data action. Right now, every time I need to get more data, I need to change the date on Source /Date filter…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,012 questions
asked 2024-11-12T20:28:56.61+00:00
Alex Nieto Castro 0 Reputation points
commented 2024-11-21T02:12:10.69+00:00
Ganesh Gurram 1,510 Reputation points Microsoft Vendor
1 answer

In Azure SQL Pool we have metrics like Failed Connections : System Errors and Failed Connections : User Errors, but how can we find out what exactly was the error?

In Azure SQL Pool we have metrics like Failed Connections : System Errors and Failed Connections : User Errors, but how can we find out what exactly was the error? How to find out which session was impacted and what error was associated with which…

Azure SQL Database
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,012 questions
asked 2024-11-19T14:21:48.5+00:00
Nilesh Shrimant 0 Reputation points Microsoft Employee
commented 2024-11-21T00:46:07.39+00:00
Sai Raghunadh M 1,125 Reputation points Microsoft Vendor
0 answers

How to read secrets from AKV and access an API using those secrets in Azure Synapse Notebooks ?

I have a usecase to be able to read secrets from an AKV in another subscription and use them to get data from an API in the same subscription. I have created a linked Service for Azure Key Vault in Synapse Analytics that has the secrets for API…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,012 questions
asked 2024-11-18T17:51:17.6866667+00:00
Sravan Kumar Sumala (Tata Consultancy Services) 0 Reputation points Microsoft Vendor
commented 2024-11-20T18:30:06.4866667+00:00
Ganesh Gurram 1,510 Reputation points Microsoft Vendor
0 answers

Select transformation output schema is empty after renaming columns

I've followed the example from the link: https://learn.microsoft.com/en-us/azure/data-factory/tutorial-data-flow-dynamic-columns It's exactly what I need for my project, but unfortunately, no matter what I do, the output schema of the select…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,012 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,908 questions
asked 2024-11-20T16:26:53.2266667+00:00
AdnanT 0 Reputation points
edited a comment 2024-11-20T16:30:35.5333333+00:00
AdnanT 0 Reputation points
2 answers One of the answers was accepted by the question author.

How to copy all tables of a Schema to .csv file format in respective folders

Hi, I am trying to copy all tables of Schema-SALES from SQL Server to .csv file format in ADF and files of each table must copy in respetive folder for example. source (SQL SERVER Tables) SALES.Customer SALES. Address …

Azure SQL Database
Azure Functions
Azure Functions
An Azure service that provides an event-driven serverless compute platform.
5,153 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,012 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,908 questions
asked 2023-12-22T21:18:17.5066667+00:00
Zaeemul Haque 45 Reputation points
commented 2024-11-20T15:37:53.82+00:00
Wenrong Xu 0 Reputation points
0 answers

How to add expression on result of aggregate function when create Materialized View in Synapse

Hi there, When I creating materialized view in synapse, i got an error, it says "because the select list of the view contains an expression on result of aggregate function or grouping column. Consider removing expression on result of aggregate…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,012 questions
asked 2024-11-12T05:57:27+00:00
zmsoft 115 Reputation points
commented 2024-11-20T04:47:21.56+00:00
phemanth 11,460 Reputation points Microsoft Vendor
1 answer

New Synapse/ADF Postgres Linked Service does not work with 'time without time zone' datatype.

The current legacy linked service driver supports tables that use the 'time without timezone' datatype. The new linked service driver gives the following error when trying to read tables with this…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,012 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,908 questions
asked 2024-11-19T14:45:46.39+00:00
Vike King 0 Reputation points
answered 2024-11-19T19:41:56.3033333+00:00
Sina Salam 12,731 Reputation points
3 answers

Datetime2 error when querying parquet file produced from Synapse copy activity from OData Business Central Source (data seems to be changed from 0001-01-01 to 0000-12-30)

I have a pipeline running a copy activity to copy data from Business Central OData source to parquet file everyday. Everything works fine before 16/07/2024 but problem arises starting from 17/07/2024. The parquet file no longer be able to query from…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,012 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,908 questions
asked 2024-07-24T15:13:17.94+00:00
Victor Chu 15 Reputation points
answered 2024-11-19T16:02:43.4+00:00
Jeff S 0 Reputation points
1 answer One of the answers was accepted by the question author.

Get Pipeline Runs by Workspace API not functioning as expected

Calling the Get Pipeline Runs by Workspace API does not produce the expected results. Calling the API without any filters / sorts in the body produces a paged list of 100 pipeline runs, but as soon as any of the following are passed as body the result…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,012 questions
asked 2022-03-24T07:48:54.533+00:00
Max 31 Reputation points
commented 2024-11-19T14:24:14.7433333+00:00
Maria Belén Tualombo 0 Reputation points
1 answer One of the answers was accepted by the question author.

Dynamic Data Masking On Synapse Serverless SQL Database

Is it possible to implement dynamic data masking on an external Synapse Serverless pool?For context we are implementing a delta lake and the analytics teams will be accessing data via a SQL Serverless pool.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,012 questions
asked 2024-11-19T09:59:00.7633333+00:00
WZIAFP 182 Reputation points
accepted 2024-11-19T12:44:04.2+00:00
WZIAFP 182 Reputation points
2 answers

How can I write to a Dataverse lookup using an alternate key?

Hi I want to write data to Dataverse via a Synapse Copy Data task in a pipeline. The destination tables all have alternate keys set up. So for example, I could have a Country entity, with CountryAlternateKey (e.g. ISO code) and Name, and a City with…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,012 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,908 questions
asked 2024-11-13T10:32:20.5433333+00:00
Duncan Pryde 1 Reputation point
commented 2024-11-19T01:06:20.76+00:00
Chandra Boorla 3,460 Reputation points Microsoft Vendor
0 answers

Identifying Unused Tables in AAS Cube Over the Last 30 Days

I have a question regarding identifying unused tables in Azure Analysis Services (AAS). In our organization, we’re using AAS, and due to limited storage, our cube refresh is failing. I’ve been tasked with finding a list of tables that haven’t been used…

Azure Analysis Services
Azure Analysis Services
An Azure service that provides an enterprise-grade analytics engine.
460 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,012 questions
SQL Server Reporting Services
SQL Server Reporting Services
A SQL Server technology that supports the creation, management, and delivery of both traditional, paper-oriented reports and interactive, web-based reports.
2,944 questions
asked 2024-11-07T16:03:40.6433333+00:00
madmax 0 Reputation points
commented 2024-11-19T00:56:57.1966667+00:00
Chandra Boorla 3,460 Reputation points Microsoft Vendor
2 answers One of the answers was accepted by the question author.

How to reference to an unpublished notebook in a pipeline in synapse

Hi, I have a similar question to the post here which does not seem to be…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,012 questions
asked 2023-05-01T00:07:24.5+00:00
Kobra Alizadeh 45 Reputation points
commented 2024-11-18T12:23:34.95+00:00
Richard Scholtens 0 Reputation points
1 answer

Dataflow debug only shows 100 rows even if the query returns >100 records. Row limit is set to 1000.

Dataflow debug only shows 100 rows in the web UI in tabular format even if the query returns >100 records. Row limit is set to 1000. Is this the default behavior in azure synapse analytics? I know this is a display only behavior as I am able to join…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,012 questions
asked 2024-11-14T15:57:56.0666667+00:00
Nandu S Raj 20 Reputation points
commented 2024-11-18T07:43:33.8166667+00:00
AnnuKumari-MSFT 33,551 Reputation points Microsoft Employee
1 answer

Getting error "Login failed for user '

I have a resource group under which I have created a sql pool and Synapse workspace. Whenever I am running a query like "CREATE SCHEMA foodmart" it is giving the following error. "Login failed for user '

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,012 questions
asked 2024-11-14T10:31:52.93+00:00
Shiv 0 Reputation points
commented 2024-11-18T06:29:09.1966667+00:00
Ganesh Gurram 1,510 Reputation points Microsoft Vendor
2 answers

How to save complete web activity output to ADLS Gen2 in JSON format? Azure Synapse Studio

I want to save the output of my Web activity (which hits an Api and then fetches data from that Api in Json format) into blob storage account container. Also, my web activity is within a foreach - so multiple Api links are being hit and multiple files…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,012 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,908 questions
asked 2024-10-24T05:42:30.79+00:00
Mitashi Malkani 0 Reputation points
commented 2024-11-18T01:09:46.1633333+00:00
Chandra Boorla 3,460 Reputation points Microsoft Vendor