4,874 questions with Azure Synapse Analytics tags

Sort by: Updated
0 answers

Access roles and Permission

Hi Team, We need to access synapse views from power bi and create dashboard reports. We have created AD group and provided SQL grant access to the AD groups. What else do we require so the power bi users can have least privileged access. Is it Synapse…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,874 questions
asked 2024-09-19T21:50:19.28+00:00
Sourav 100 Reputation points
0 answers

How to troubleshoot Azure Synapse Link failing to create/modify model.json

Hello, I am having issues with Azure Synapse Link failing to create or modify the model.json file in the blob. This only started happening yesterday. Can someone provide advice on what might be causing this issue and how to resolve it? Thank you. Best…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,874 questions
Microsoft Dataverse Training
Microsoft Dataverse Training
Microsoft Dataverse: A Microsoft service that enables secure storage and management of data used by business apps. Previously known as Common Data Service.Training: Instruction to develop new skills.
31 questions
asked 2024-09-19T20:47:53.33+00:00
Vidhya Ramesh 0 Reputation points
edited the question 2024-09-19T21:42:58.8133333+00:00
KarishmaTiwari-MSFT 19,952 Reputation points Microsoft Employee
1 answer

Trouble Granting Managed Identity Access for Pausing/Resuming Azure synpase

I’m fairly new to Azure and even though this might seem like a simple task, I’m finding it challenging. I’ve set up an Azure Synapse workspace with a dedicated SQL pool, and my assignment is to schedule pausing and resuming the pool. I followed a…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,874 questions
asked 2024-09-18T16:48:59.8633333+00:00
Thomaskyle 360 Reputation points
commented 2024-09-19T20:15:48+00:00
Smaran Thoomu 15,040 Reputation points Microsoft Vendor
1 answer

Unable to see all the lake database tables in synapse workspace

Hello, I am unable to see the Lake Database tables inside db blade on left side of synapse workspace, only few are visible but rest are not visible but I am able to see them through SSMS and also execute query on them. In fact, these tables are not…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,874 questions
asked 2024-09-17T15:34:39.9633333+00:00
Jaya Ojha 60 Reputation points
commented 2024-09-19T19:40:44.3866667+00:00
Smaran Thoomu 15,040 Reputation points Microsoft Vendor
1 answer

adf/synapse - how to copy all files based on given lastmodified date from source container and save in sink container in respective folder based on extension

Req: Copy files from one container and store in another container- I am specifying the last modified date , i want to copy files only before that last last modified date. The files are of any type. csv,xml,json,txt etc. Also, in source container my files…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,874 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,593 questions
asked 2024-09-17T20:33:13.42+00:00
Wasim 0 Reputation points
commented 2024-09-19T18:01:28.8033333+00:00
NIKHILA NETHIKUNTA 1,920 Reputation points Microsoft Vendor
1 answer One of the answers was accepted by the question author.

Notebook clusters in pipeline parallel processes

I have a pipeline triggered daily which loops through a list of notebooks, and runs them using a cluster in a for each run in parallel. At the moment I have seven notebooks running and adding more over time. What would happen when the cluster runs more…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,874 questions
asked 2024-09-19T12:59:09.1533333+00:00
Iwan 20 Reputation points
accepted 2024-09-19T15:27:47.7433333+00:00
Iwan 20 Reputation points
2 answers

How to configure use of access token and API key in a linked service

Authorization and x-api-key headers have been added to linked service for connection to C365 cloud service. Can't understand reason for error. Please help { "errorCode": "2200", "message": "Failure happened on 'Source'…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,874 questions
asked 2024-09-17T22:03:04.67+00:00
A C (BI) 0 Reputation points
answered 2024-09-19T14:42:13.4033333+00:00
A C (BI) 0 Reputation points
2 answers

How to Set Up Automatic D365 Finance and Operations Data Replication to Azure Data Lake for Reporting?

Hi everyone, We have a D365 Finance and Operations environment hosted in the Central US region. Our Accounts Receivable (AR) data, including customers and invoices, is integrated from an on-premises Oracle database into D365 FinOps. I would like to…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,874 questions
Dynamics 365 Training
Dynamics 365 Training
Dynamics 365: A Microsoft cloud-based business platform that provides customer relationship management and enterprise resource planning solutions.Training: Instruction to develop new skills.
124 questions
asked 2024-09-04T14:06:33.1033333+00:00
Nitin Patil 20 Reputation points
commented 2024-09-19T14:11:00.1333333+00:00
Nitin Patil 20 Reputation points
2 answers

Open row source

nsnapshot.txt Hi, how to run json file on synapse workspace.. Tried with open row set but not working.. Pls share screenshot if sny

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,874 questions
asked 2024-09-02T15:47:54.2266667+00:00
Vineet S 770 Reputation points
commented 2024-09-19T08:18:17.6866667+00:00
AnnuKumari-MSFT 32,821 Reputation points Microsoft Employee
1 answer

How to query in synapse pipeline activity runs using api

Hi, How to query in synapse pipeline activity runs using api, i want to know inside pipeline how many activities we are running per day any option is there to find out this in synapse

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,874 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,593 questions
asked 2024-09-12T18:30:24.2166667+00:00
Venki Bimma 0 Reputation points
commented 2024-09-19T08:05:50.52+00:00
AnnuKumari-MSFT 32,821 Reputation points Microsoft Employee
1 answer

Creating a pipeline to map data from Salesforce to Business Central using Azure Data Factory

Hi everyone, I’m working on creating a pipeline to map data from Salesforce to Business Central using Azure Data Factory. Here are the steps I’ve taken so far: Copy Data: I’m using the Copy Data activity to get the data into a CSV file. Azure Blob…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,874 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,593 questions
asked 2024-09-16T18:30:01.1433333+00:00
Vaibhav Patil 235 Reputation points
commented 2024-09-19T08:01:47.9633333+00:00
AnnuKumari-MSFT 32,821 Reputation points Microsoft Employee
1 answer One of the answers was accepted by the question author.

Can we execute Synapse Spark Notebook on synapse workspace from azure DevOps pipeline ?

Hi, I want to know Can I execute Synapse Spark Notebook on synapse workspace from the Azure DevOps pipeline ?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,874 questions
asked 2024-01-09T10:10:50.5433333+00:00
Siddharth Joshi 231 Reputation points
edited the question 2024-09-19T07:44:59.9533333+00:00
Siddharth Joshi 231 Reputation points
1 answer One of the answers was accepted by the question author.

How to overwrite a table from SQL Server to SQL Dedicated Pool using Copy Data Activity in Azure Synapse Analytics

I am trying to use the Copy Data Activity in Azure Synapse Analytics to copy data from SQL Server to SQL Dedicated Pool. However, I want to ensure that every time I run the Copy Data Activity, the table in SQL Dedicated Pool is overwritten. How can I…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,466 questions
Azure Storage Explorer
Azure Storage Explorer
An Azure tool that is used to manage cloud storage resources on Windows, macOS, and Linux.
254 questions
Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
3,114 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,874 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,593 questions
asked 2024-09-18T08:58:39.26+00:00
Aditya Singh 135 Reputation points
accepted 2024-09-19T05:17:18.4233333+00:00
Aditya Singh 135 Reputation points
1 answer

Stop and start Synapse pipeline triggers using pipeline

Hello, Is there a way to stop and start triggers using a Synapse Pipeline. I have tried with API mechanism like…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,874 questions
asked 2024-09-12T13:13:06.59+00:00
Kumar, Arun 336 Reputation points
commented 2024-09-18T18:00:25.6433333+00:00
Smaran Thoomu 15,040 Reputation points Microsoft Vendor
1 answer One of the answers was accepted by the question author.

Fabric or ADF dataflows?

Hi I’m currently evaluating whether to use Fabric Data Flow or Azure Data Factory Data Flow for a specific data transformation project. In my scenario, I need to process and transform large volumes of sales data from multiple sources (including SQL…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,874 questions
asked 2024-09-18T09:09:29.09+00:00
Rubens Max 40 Reputation points
accepted 2024-09-18T17:09:45.64+00:00
Rubens Max 40 Reputation points
1 answer

How to make Log send to stderr and also shows in cell output

Hi Team, May I know in Synapse pyspark notebook, how can we write log to stderr, and also shows it in the cell output? I try to write the log with log4j, log will goes to stderr log, but will not shows in cell output But if we try with different log…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,874 questions
asked 2024-09-12T20:31:49.4966667+00:00
Jiacheng Zhang 5 Reputation points
commented 2024-09-18T16:49:06.8533333+00:00
phemanth 10,250 Reputation points Microsoft Vendor
1 answer

ADF Pipeline failing with an error saying column can be found

I have a pipeline that looks up a query to define the list of tables from source and usin for loop it should load data to Target Synapse pool but it is failing with following error on copy command.…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,874 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,593 questions
asked 2024-09-11T20:01:56.4766667+00:00
Jiby Jacob 65 Reputation points
commented 2024-09-18T16:28:16.6266667+00:00
phemanth 10,250 Reputation points Microsoft Vendor
1 answer

Job Queueing with Microsoft Fabric

Hi Team, We have a scenario where we need to move data from Oracle to One lake on demand. We are having a table where a user enters the configuration similar to batch and on each insert it needs to trigger the data movement pipelines .However I don't…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,874 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,593 questions
Microsoft Fabric Training
Microsoft Fabric Training
Microsoft Fabric: A Microsoft unified data platform.Training: Instruction to develop new skills.
43 questions
asked 2024-09-16T11:41:45.1066667+00:00
Nitya V 45 Reputation points
commented 2024-09-18T14:49:24.5666667+00:00
Smaran Thoomu 15,040 Reputation points Microsoft Vendor
1 answer

DATA_COMPRESSION = COLUMNSTORE_ARCHIVE not working for partitioned table

I created partition table(24 partition) with DISTRIBUTION = ROUND_ROBIN,   CLUSTERED COLUMNSTORE INDEX . Table size was 300 GB but after DATA_COMPRESSION = COLUMNSTORE_ARCHIVE the size increased many folds(7-8 times).Does partitioned table archive is not…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,874 questions
asked 2024-09-13T07:33:21.6633333+00:00
Rajiv Kumar Tiwari 0 Reputation points
commented 2024-09-18T10:09:11.3966667+00:00
Vinodh247 18,906 Reputation points
1 answer

My dataflow activity failed in Synapse pipeline

Hello, I created a data flow pipeline composed of source to sink and each time it runs i get this error : how can i fix it ? I tried raising the number of partitions but it did not work Thank you {"message":"Job failed due to reason: at…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,874 questions
asked 2024-09-13T07:09:32.54+00:00
WAJIH Arfaoui 0 Reputation points
commented 2024-09-18T10:09:06.9833333+00:00
Vinodh247 18,906 Reputation points