About partitioned parquet files on ADLS2
Hi everyone. I have the following scenario: a ADF pipeline stores a partitioned parquet file on ADLS2 a Synapse Spark Pool will read the data The partitioned data looks like this (step 1): Is this an optimal way of storing parquet data that will…
Azure Function: Issues with BlobTrigger Configuration and Namespace Reference Errors
I'm encountering persistent issues with configuring a BlobTrigger in my Azure Function and need some assistance. Here's a summary of the problem and the steps taken so far: Problem Description: Trying to set up an Azure Function that processes .gz log…
Changing ADF Trigger changes Advanced Filters in Container Blob EventGrid
Hi, I am using SFTP in a Storage Container set up with an EventGrid that triggers an ADF pipeline when a new file is uploaded to the container. My event grid subscription is set to the filters values you can see in the first attached image. With the…
Connecting Azure logic app with storage account to generate SAS URI
I am trying to connect to Azure storage account from Azure Logic Apps using Managed Identity to generate Delegation SAS for blobs. I have followed this documentation to create the workflow:…
Setting the "defaultServiceVersion" makes no difference on requests without the "x-ms-version" headers set
Hello, I've used the following command to set the "defaultServiceVersion" unto our Storage Account: az storage account blob-service-properties update --set defaultServiceVersion="2020-04-08" --account-name FOOBAR So that when I…
My app is in Java8 and I want to use Azure Blob storage and App service and their SDKs. By when I will get the Java 8 support SDKs?
My app is in Java8 and I want to use Azure Blob storage and App service and their SDKs. By when I will get the Java 8 support SDKs?
Blob Triggered Azure Function Inconsistent Behavior Across User Groups
There is a Blob storage triggered Azure Function that works when certain users (User set A) update files to the blob storage, but it does not work most of the time for another group of users (User set B) when they load files. Interestingly, if a member…
Unable to write rows into sink from SAP CDC Connector
I am working on extracting data from SAP BW and writing it to Azure Blob Storage using an ETL pipeline. Initially, I experimented with delta/incremental loads, but now I need to perform a full load. However, after switching back, I am unable to get any…
Index Custom metaData properties to a specific index
I have this custom metadata defined in a file: I want to pass them to my fields in my index so that I can use them to filter my search, here's the field structure: I'm having an issue passing this custom metadata values, can someone help me?…
Azure Blob SFTP services cost
Azure blob sftp has hourly transaction cost $0.30 per hour which comes about $220 per month. If I have 40 containers in blog with 40 users uploading, would it go as many folds or it is flat $0.30 cost regardless of number of container.
Gzip file uploaded to Azure Blob Storage, when downloaded to Windows machine does not open and the file size is not same
I am uploading a csv file with gzip encoded to Azure Blob Storage using C# .net 8. I am able to read the file ok when I download file and read data use .Net code. But I have two problems. When I download the file to my local Windows laptop and try to…
Azure storage account Life cycle management Policy not working at container level
Hi Team, I'm trying to delete any block blob from a specific container whose last modified date date is one day old. I'm using Storage account Lifecycle Management to accomplish that. When I tested with "container name/blob's first letter" e.g.…
Backup Azure BlobStorage
Dear good I need to configure a daily backup policy to a Blob Storage in Azure. Version: BlockBlobStorage. After creating the backup Vault, I try to add the blobstorage that I need to backup but it does not allow me. Could you please tell me step by step…
azure storage account is iaas or paas?
Hi team, is azure storage account is iaas or paas? i know storage is iaas but since i am not managing the storage server, availability/dependencies behind the azure storage account i think it is paas? please confirm
On Portal: The "Events" section of every Storage Account returns an error
Hello, When I open up the "Events" section of each of our Azure Storage Accounts, I get an error: 'onInitialize' must return a Promise that covers the full initialization of the Blade, including data-loading. The Storage Accounts are all in…
Issues with Streaming File Response from Azure App Service
Hi, We are facing issues with streaming file response from Azure App Service. We are reading the blob and returning a file stream response from an API hosted on Azure App Service. We noticed that when the code is deployed to App Service, it does not…
Cloud functions - Host instance 'xxxxxxxxxxxxx' failed to acquire host lock lease: Azure.Storage.Blobs:
I have a function app attached to a storage account with 3 functions with timer triggers that randomly stopped working since last month. Any pointers to troubleshoot? Log stream pasted below --------------------------------- …
I am integrating the dataflow activity which removes duplicates from the csv file to the existing pipeline i have. I need a help to configure the parameters.
I created a dataflow activity which removes duplicates from the source files( csv formatted files). So now i integrated this dataflow activity to existing pipeline i have. but i am not able to parametrize the source files. It would be helpful if i get…
Read/Write cost of archived blobs on Azure Storage Gen2
This documents here details the price for Read/Write operations for blobs on Archive tier: https://azure.microsoft.com/en-gb/pricing/details/storage/blobs/ However, it is not possible to do these kinds of operations without rehydrating the blobs…
Transition blobs to a cooler storage tier (Hot to Cool, Hot to Archive, Cool to Archive) to optimize for performance and cost. How it will improve performance when there will be latency?
Transition blobs to a cooler storage tier (Hot to Cool, Hot to Archive, Cool to Archive) to optimize for performance and cost. How it will improve performance when there will be latency? Correct me if I am wrong. Link of the Microsoft learn content :…