1,510 questions with Azure Data Lake Storage tags

Sort by: Updated
2 answers

ADLS Gen2 operation failed for: Operation returned an invalid status code 'Conflict'. Account: 'abc'. ErrorCode: 'EndpointUnsupportedAccountFeatures'. Message: 'This endpoint does not support BlobStorageEvents or SoftDelete.

I am new to ADF. while creating linked service for data lake storage Gen2 I am getting a error ADLS Gen2 operation failed. ADLS Gen2 operation failed for: Operation returned an invalid status code 'Conflict'. Account: 'abc'. ErrorCode:…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,510 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,044 questions
Azure App Service
Azure App Service
Azure App Service is a service used to create and deploy scalable, mission-critical web apps.
8,084 questions
asked 2024-12-21T17:12:26.5366667+00:00
manoj reddy 0 Reputation points
edited an answer 2024-12-21T19:36:36.2+00:00
Sina Salam 14,001 Reputation points
0 answers

issues in synapse pipelines which accessing the checkpoints key with input parameters

hello team, i am getting synapse analytics pipelines failures with error referring the checkpoint mistaching with the checkpoint in input parameters. tried to check the input as the respective dataflow is fetching data from cosmosDb with CDC approach…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,510 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,088 questions
asked 2024-12-20T14:24:05.0233333+00:00
ANKIT GHENGE 40 Reputation points
commented 2024-12-20T18:32:21.4666667+00:00
Ganesh Gurram 2,380 Reputation points Microsoft Vendor
3 answers

Troubleshooting Power BI and Azure Storage Explorer Connection Issues to Data Lake Gen2 from Azure VM

I rented a virtual machine (VM) and had no issues using it until I needed to integrate it with the Data Lake to optimize my processes. I subscribed to the Data Lake, but I cannot connect to it through Power BI when using the VM. My account is a Gmail…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,510 questions
Azure Storage Explorer
Azure Storage Explorer
An Azure tool that is used to manage cloud storage resources on Windows, macOS, and Linux.
271 questions
Azure Virtual Machines
Azure Virtual Machines
An Azure service that is used to provision Windows and Linux virtual machines.
8,166 questions
Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
3,290 questions
asked 2024-12-10T11:54:22.8833333+00:00
Rafael CST 80 Reputation points
commented 2024-12-20T14:30:57.0733333+00:00
Hari Babu Vattepally 1,195 Reputation points Microsoft Vendor
1 answer

When generating a SAS token, specifying the path causes an authorization failure.

I use following code to generate SAS token, when path is null or empty string, it's working. String sasToken = new DataLakeSasImplUtil(signatureValues, container, path, true) .generateUserDelegationSas(userDelegationKey, accountName,…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,510 questions
Azure Data Lake Analytics
asked 2024-12-12T14:52:46.71+00:00
Jun 0 Reputation points
edited an answer 2024-12-19T01:21:35.9733333+00:00
Keshavulu Dasari 2,410 Reputation points Microsoft Vendor
2 answers One of the answers was accepted by the question author.

How to monitor data lake sas token expired?

Hi there, I have store sas token value in key vault, but I can't know when token expires. So I will find this issue after the token expires. Is there any way to monitor when the token expires? Thanks zmsoft

Azure Key Vault
Azure Key Vault
An Azure service that is used to manage and protect cryptographic keys and other secrets used by cloud apps and services.
1,340 questions
Azure Monitor
Azure Monitor
An Azure service that is used to collect, analyze, and act on telemetry data from Azure and on-premises environments.
3,394 questions
Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,510 questions
asked 2024-12-10T07:42:01.56+00:00
zmsoft 200 Reputation points
accepted 2024-12-18T10:50:05.8233333+00:00
zmsoft 200 Reputation points
1 answer

How cn i restrict someone from not downloading any data from Fabric Lakehouse or Fabric warehouse

As a data admin, i want to control data access for a user in your Microsoft Fabric Warehouse. The goal is to allow this user, who has a Contributor role, to view data directly in the workspace without being able to download it as a file. This scenario…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,510 questions
asked 2024-11-05T05:14:23.56+00:00
Jain, Shreyans 0 Reputation points
edited the question 2024-12-18T06:34:30.58+00:00
RNareddy 1,430 Reputation points Microsoft Vendor
1 answer

In MS fabric users able to view data but cannot download it

In MS Fabric, I want users to be able to view data in the workspace but not be able to download it. Please provide clear steps, along with links to verify the authenticity of the solution provided.

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,510 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,044 questions
SharePoint
SharePoint
A group of Microsoft Products and technologies used for sharing and managing content, knowledge, and applications.
10,999 questions
asked 2024-11-11T11:51:04.92+00:00
Jain, Shreyans 0 Reputation points
edited the question 2024-12-18T06:33:29.7366667+00:00
RNareddy 1,430 Reputation points Microsoft Vendor
2 answers

Append vs update in Azure Data Lake Storage Gen2 for a csv file.

I have a CSV file in a Data Lake Storage Gen2. I am referring to the ACL permissions below.https://learn.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-access-control#common-scenarios-related-to-acl-permissionsThe table gives different ACL…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,510 questions
Azure Storage Accounts
Azure Storage Accounts
Globally unique resources that provide access to data management services and serve as the parent namespace for the services.
3,290 questions
asked 2024-12-10T03:23:07.9433333+00:00
Ravikiran Srinivasulu 10 Reputation points
commented 2024-12-16T03:52:40.77+00:00
Keshavulu Dasari 2,410 Reputation points Microsoft Vendor
1 answer

Trying to connect to the Fabric Lakehouse from the SSIS Package. However it is failing when executing the package

I have Fabric Lakehouse as a Source , I am able to connect to the Fabric Lakehouse via Authentication as "ActiveDirectoryPassword" from SSMS without any issue. I am creating the SSIS package and created the ADO.NET connection Manager and…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,510 questions
SQL Server Integration Services
SQL Server Integration Services
A Microsoft platform for building enterprise-level data integration and data transformations solutions.
2,616 questions
asked 2024-12-12T22:39:50.1766667+00:00
Vineeta Trivedi 0 Reputation points
commented 2024-12-16T01:42:10.08+00:00
Chandra Boorla 5,755 Reputation points Microsoft Vendor
2 answers One of the answers was accepted by the question author.

Azure Data Lake Storage NFSv3 Protocol support for nconnect for Redhat

Hi, I have a ADLS Storage Account configured for HNS and NFSv3 protocol support. When attempting to mount the ADLS container on a Azure RedHat 9.5 NFS Client instance with the nconnect mount option set it fails with. $ sudo mount /mntfs/adls01c01…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,510 questions
asked 2024-12-05T00:32:40.59+00:00
Malcolm Gibbs 20 Reputation points
commented 2024-12-12T17:36:06.5866667+00:00
Amrinder Singh 5,555 Reputation points Microsoft Employee
1 answer

Possible ways to extract data from SAP Reports (Transaction Data) to ADLS Gen2

Hello, I want to extract SAP ECC transaction data into ADLS Gen2. I have multiple transaction codes (T-codes) for generating reports, such as ME5A and ME2N, and I want to fetch the data from these reports into ADLS. However, it seems that Azure Data…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,510 questions
SAP HANA on Azure Large Instances
SAP HANA on Azure Large Instances
Microsoft branding terminology for an Azure offer to run HANA instances on SAP HANA hardware deployed in Large Instance stamps in different Azure regions.
125 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,283 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,044 questions
asked 2024-12-12T06:08:53.2566667+00:00
Sulagno Roy 40 Reputation points
answered 2024-12-12T11:50:55.4933333+00:00
Nehruji R 8,161 Reputation points Microsoft Vendor
1 answer One of the answers was accepted by the question author.

How to read the last ingested date partitioned file in ADLS

Hi All, How to read the last ingested file in ADLS. ADLS folder structure: XXX/year=yyyy/month=MM/day=dd Now in the day=dd I will have two different files on a given day. I want to read the last ingested file based on the timestamp as a source in my…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,510 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,044 questions
asked 2023-05-26T05:37:49.1633333+00:00
Sulagno Roy 40 Reputation points
accepted 2024-12-12T05:46:22.51+00:00
Sulagno Roy 40 Reputation points
1 answer One of the answers was accepted by the question author.

How to read multiple files from different folders in azure data flow?

I have multiple folders from different source systems in my landing area of ADLS GEN2. Let's say I have folders named as X,Y,Z. Inside X, I again have subfolders based on the tables from where the data has been extracted. For example X has 3 subfolders…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,510 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,044 questions
asked 2023-05-26T05:30:51.0533333+00:00
Sulagno Roy 40 Reputation points
accepted 2024-12-12T05:45:18.67+00:00
Sulagno Roy 40 Reputation points
2 answers One of the answers was accepted by the question author.

Data lake name sequence

Hi friends, when creating Azure Data Lake the containers are sorted by alphabetical order, it looks a bit incorrect order : bronze, landing zone gold silver I want it in the landing, bronze, silver, and gold orders. How can I do that? Is there a…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,510 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,044 questions
asked 2024-12-09T06:29:24.98+00:00
azure_learner 525 Reputation points
accepted 2024-12-11T08:44:10.44+00:00
azure_learner 525 Reputation points
1 answer

how to fix this error The request content was invalid and could not be deserialized: Required property 'name' not found in 'sku'

getting error while synapse workspace deployment

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,510 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,088 questions
asked 2024-12-09T14:46:47.8+00:00
Narendra Singh 5 Reputation points
commented 2024-12-11T08:04:11.14+00:00
Chandra Boorla 5,755 Reputation points Microsoft Vendor
2 answers One of the answers was accepted by the question author.

ADF pipeline to read the data from UC table to adls gen2 account

Hello Team, We have a requirement to create Azure Datafactory pipeline to read the data from UC table, access on the table is provided ( to Azure Datafactory Managed Identity) and copy the data into adls gen2. Is there a way or article to implement this?…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,510 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,283 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,044 questions
asked 2024-04-11T19:05:05.9733333+00:00
Ashwini Gaikwad 130 Reputation points
answered 2024-12-06T05:09:57.8666667+00:00
AMIT KUMAR PANDA 0 Reputation points
1 answer

How cn i restrict someone from not downloading any data from Fabric Lakehouse or Fabric warehouse

As a data admin, i want to control data access for a user in your Microsoft Fabric Warehouse. The goal is to allow this user, who has a Contributor role, to view data directly in the workspace without being able to download it as a file. This scenario…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,510 questions
asked 2024-11-05T05:24:13.73+00:00
Jain, Shreyans 0 Reputation points
edited the question 2024-12-04T11:23:32.0466667+00:00
Rakesh Gurram 10,545 Reputation points Microsoft Vendor
1 answer One of the answers was accepted by the question author.

Unable to use Synapse workspace features in Synapse Link for Dataverse when Synapse network is in private mode

Hi Team, We are using Synapse Link for Dataverse for syncing data from d365 to ADLS Gen2, which can be used for analytics in ADLS Gen2. As our Synapse analytics environment network is publically disabled and using…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,510 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,088 questions
asked 2024-06-25T06:40:07.63+00:00
Sriram M 40 Reputation points
edited the question 2024-12-04T10:59:49.0366667+00:00
Rakesh Gurram 10,545 Reputation points Microsoft Vendor
0 answers

How to fix ParquetJavaInvocationException ParquetJavaInvocationException when writing parquet file in ADLS using ADF

Hi, I want to copy tables from an on premise sql server to my azure data lake and write the files in parquet fornat. I have installed the JRE on the machine which hosts the self-hosted IR. When I create a dataset with parquet as format and select schema…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,510 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,044 questions
asked 2023-10-09T13:07:05.8166667+00:00
Rutger Verhaar | Adaptfy 1 Reputation point
commented 2024-12-04T07:39:13.71+00:00
Ganbaatar Bold 0 Reputation points
1 answer

Copy Files from sharepoint online site to azure datalake storage

Hello We are trying to setup the flow which will copy files from sharepoint online site to azure datalake storage. As per my understanding there are 2 options : Using ADF to pull the files as mentioned in the link below…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,510 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,044 questions
SharePoint
SharePoint
A group of Microsoft Products and technologies used for sharing and managing content, knowledge, and applications.
10,999 questions
asked 2024-11-06T22:12:34.5+00:00
Sourav 120 Reputation points
commented 2024-12-03T06:13:45.7833333+00:00
Keshavulu Dasari 2,410 Reputation points Microsoft Vendor