Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,527 questions
1 answer
Stream RealTime data from an On Prem Microsoft Server to a Azure Data Lake.
There is a need for Real Time data to be collected from a On Prem SQL Server. This means ADF is not suitable because it only does batch. Azure Streaming Analytics only connects to Azure SQL Server and not on prem. Has anybody else encountered this and…
asked 2023-03-16T02:02:54.12+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(246.4, 50%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ESW%3C/text%3E%3C/svg%3E)
Sallie Worsley
5
Reputation points
commented 2025-01-17T23:10:26.6+00:00
Sander van de Velde | MVP
34,281
Reputation points MVP
1 answer
Stream Analytics job does not stream the data to the database
I have a Python script that sends data to the IoT Hub using MQTT. A message routing configuration is set up to route the data to a Blob storage, and this part is working as expected—I can see the data in the storage. My next goal is to route the data to…
asked 2025-01-17T14:57:57.25+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(182.40000000000003, 35%, 27%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKA%3C/text%3E%3C/svg%3E)
Klajderic Aljosa HSLU I
0
Reputation points
answered 2025-01-17T22:59:46.1466667+00:00
Sander van de Velde | MVP
34,281
Reputation points MVP
1 answer
Debugging Data Loss in Stream Analytics to Event Hubs and ADF
My goal is to stream telemetry data from blob storage files into a Azure Data Factory database. I have set up a stream analytics job that takes data from blob storage, bins it by hour, and then passes it through an event hub with two partitions in order…
asked 2025-01-16T03:01:19.43+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 28.999999999999996%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAZ%3C/text%3E%3C/svg%3E)
Annie Zhou
0
Reputation points Microsoft Employee
commented 2025-01-17T17:31:50.76+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Smaran Thoomu
19,140
Reputation points Microsoft Vendor
2 answers
Adjusting Lateness Tolerance in Azure Stream Analytics
A query is being run using Azure Stream Analytics to send data binned by hour into an event hub, which subsequently sends it into a Kusto database. However, there appears to be an issue, as approximately 1,000 messages are missed each day. The logs…
asked 2025-01-16T02:56:18.8833333+00:00
Annie Zhou
0
Reputation points Microsoft Employee
commented 2025-01-17T08:25:50.9566667+00:00
Smaran Thoomu
19,140
Reputation points Microsoft Vendor
0 answers
How to configure late arrival policy to handle events that arrive later than configured tolerance window
I want to configure a late arrival policy and increase the tolerance of my Stream Analytics. While I can see documentation explaining late arrival policies…
asked 2025-01-16T15:52:16.5+00:00
Annie Zhou
0
Reputation points Microsoft Employee
commented 2025-01-17T06:22:28.9233333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(201.6, 18%, 29%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EGG%3C/text%3E%3C/svg%3E)
Ganesh Gurram
3,110
Reputation points Microsoft Vendor
1 answer
duplicate key value violates unique constraint
Hi, I'm experiencing this issue from time to time when inserting values into a PostgreSQL database as output from the stream analytic, every 15 minutes Here the detailed version of it: First Occurred: 1/7/2025 8:09:22 PM UTC | Resource Name:…
asked 2025-01-07T20:20:31.5433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(224.00000000000003, 69%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAP%3C/text%3E%3C/svg%3E)
Augusto Piva
35
Reputation points
commented 2025-01-09T13:51:08.3766667+00:00
Augusto Piva
35
Reputation points
1 answer
One of the answers was accepted by the question author.
How to enable Stream Analytics Job in EAST US 2 EUAP and CENTRAL US EUAP canary regions?
We couldn't create Stream Analytics Jobs in our EUAP Canary Production Subscriptions on East US 2 EUAP and Central US EUAP. Could you help allow EUAP on these subscriptions or tell me which TSG or doc I should follow? Error:…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(128, 47%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ERZ%3C/text%3E%3C/svg%3E)
1 answer
Stream Analytics: Referring an input from blob storage in JOIN resulted "The join predicate is not time bounded. JOIN operation between data streams requires specifying max time distances between matching events. Please add DATEDIFF to the JOIN"
Hello, I'm trying to refer a blob storage input config in our query window to determine the threshold value of the event value. But while joining the 2 tables resulting in below error: The join predicate is not time bounded. JOIN operation between data…
asked 2024-12-15T23:39:13.72+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(76.8, 71%, 17%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EA%3C/text%3E%3C/svg%3E)
azureutthunga6
0
Reputation points
commented 2024-12-18T15:34:31.5333333+00:00
Smaran Thoomu
19,140
Reputation points Microsoft Vendor
1 answer
Azure Stream Analytics Job Produces No Output Despite Successful Query Tests and No Runtime Error
Hello, I am encountering an issue with my Azure Stream Analytics job. The job runs without any errors in the monitoring metrics, and when I test the queries individually using the query editor, they produce the expected results. However, the job does not…
asked 2024-12-12T10:03:38.9733333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(144, 22%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETA%3C/text%3E%3C/svg%3E)
Thanaphon Amattayakul
0
Reputation points
commented 2024-12-18T01:47:13.46+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(99.2, 65%, 19%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECB%3C/text%3E%3C/svg%3E)
Chandra Boorla
6,780
Reputation points Microsoft Vendor
1 answer
Azure Function cannot process data streaming at 10 Hz
Hi I have the following architecture I am using the Azure Function to be able to save data in CosmosDB for Mongo since this is not supported by the Azure Streaming Analytics API and we need to use MongoDB. All is working but when I test with…
asked 2024-12-03T09:52:23.3433333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(89.60000000000001, 53%, 18%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAM%3C/text%3E%3C/svg%3E)
Alberto Morando
25
Reputation points
commented 2024-12-10T09:38:06.2+00:00
Alberto Morando
25
Reputation points
0 answers
What are the feature supported by IoT Edge jobs for Stream Analytics
I want to write UDF for IoT Edge Stream Analytics, but seems it does not support by IoT Edge job of stream analytics. Can someone confirm, below limitations are still valid for IoT Edge jobs of stream analytics ? Found from this old link.
asked 2024-11-29T15:19:11.8+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 32%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAN%3C/text%3E%3C/svg%3E)
Admin Nayan Khant
0
Reputation points
commented 2024-12-03T01:52:25.16+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(288, 61%, 37%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EP%3C/text%3E%3C/svg%3E)
phemanth
13,060
Reputation points Microsoft Vendor
2 answers
One of the answers was accepted by the question author.
What factors affect the CPU utilization of Stream Analytics jobs?
I have two Stream Analytics jobs with the same configuration. One processes approximately 500k input events daily, while the other processes only 10k. However, the job that processes 10k input events daily consistently has a CPU utilization of 80%, an…
asked 2024-11-26T08:03:03.57+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 95%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKJ%3C/text%3E%3C/svg%3E)
kunming jian
80
Reputation points
accepted 2024-11-28T03:30:04.8933333+00:00
kunming jian
80
Reputation points
1 answer
One of the answers was accepted by the question author.
Azure Stream Analytics Job to save data to CosmosDB for Mongo
Hi I am creating an IoT solution I have connected the Azure Stream Analytics job with CosmosDB NoSQL and it si working fine, but I would like to connect to the CosmosDB for Mongo since we are used to work with Mongo DB. More over The CosmosDB is…
asked 2024-11-25T09:59:29.8066667+00:00
Alberto Morando
25
Reputation points
accepted 2024-11-25T14:23:12.3233333+00:00
Alberto Morando
25
Reputation points
2 answers
When will the Kafka as an input source for Azure Stream Analytics become general available
Kafka as an input source for Azure Stream Analytics is now almost in public preview for one year. I wonder when it becomes GA. Thanks See https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-define-kafka-input
asked 2024-10-14T15:52:11.8866667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(240, 57.99999999999999%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EH%3C/text%3E%3C/svg%3E)
hoi
0
Reputation points
answered 2024-11-18T19:27:56.67+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(9.6, 57.00000000000001%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EVS%3C/text%3E%3C/svg%3E)
Vaibhav Shrivastava
0
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Where is the difference between "Real-Time-Intelligence" in Fabric and "Azure Stream Analytics"?
HI, https://learn.microsoft.com/en-us/fabric/get-started/microsoft-fabric-overview has as components (a.o.) Real-Time Intelligence and some Synapse-Services. But in https://learn.microsoft.com/en-us/fabric/real-time-intelligence/overview Stream Analytics…
asked 2024-11-10T18:17:22.05+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(163.2, 92%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMS%3C/text%3E%3C/svg%3E)
Michael Schmidt
340
Reputation points
accepted 2024-11-11T09:58:35.29+00:00
Michael Schmidt
340
Reputation points
2 answers
User is not licensed for Power BI
Hello. I am a student and have a project where i have to use powerBi. All other students in my class have access, but not me. My teacher tells me that i have to solve this on my own. i cant find any support from microsoft. Anyone that can help og guide…
asked 2024-11-05T07:44:50.45+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(224.00000000000003, 82%, 31%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ETD%3C/text%3E%3C/svg%3E)
Thomas Damkjær
0
Reputation points
commented 2024-11-07T18:47:48.7266667+00:00
Smaran Thoomu
19,140
Reputation points Microsoft Vendor
2 answers
Not seeing "WHen last Stopped" option while restarting the ASA job
Hello Experts, My azure stream analytics job is not showing me the 3rd option of "When Last stopped" when I want to restart a stopped job. I just have 2 options "Now" and "Custom" Has anyone faced it and fixed it ? Any…
asked 2024-10-31T16:09:07.8666667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(32, 98%, 13%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAM%3C/text%3E%3C/svg%3E)
ARAVIND MOHANDAS
0
Reputation points
commented 2024-11-06T16:23:46.9766667+00:00
Ganesh Gurram
3,110
Reputation points Microsoft Vendor
1 answer
I have placed a .json file in the Data storage container which I have created, While I am trying the fetch the data thorough inputs from Stream analytics job, the data is not loading
I have placed the .json file in the Storage account container(Date folder-->Time folder) as per the below screenshot. And here I am trying to fetch the data which is present in the .json file in one of the input of the Stream analytics job as per the…
asked 2024-10-14T04:46:38.5933333+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(115.19999999999999, 95%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAK%3C/text%3E%3C/svg%3E)
Ayyappa Koosam
0
Reputation points
edited the question 2024-11-05T04:40:29.8566667+00:00
Sumarigo-MSFT
47,456
Reputation points Microsoft Employee
1 answer
One of the answers was accepted by the question author.
Whether the Stream Analytics service supports modifying the row records of the output target database
Hi there, I now have a scenario where I receive data from EventHub through the Azure Stream Analytics service and UPDATE the data into the Azure Synapse table, now I know INSERT is supported, but I don't know if Update is supported. How to update…
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(64, 53%, 16%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EZ%3C/text%3E%3C/svg%3E)
1 answer
One of the answers was accepted by the question author.
Streaming analytics job can't connect to Azure Event Hub input when using user assigned managed identity.
I am trying to use an Azure event hub as an input for a streaming analytics (SA) job. I want to use a user-assigned managed identity for the SA job. I followed the directions in this documentation:…
asked 2024-10-10T15:10:49.6566667+00:00
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(9.6, 55.00000000000001%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EB%3C/text%3E%3C/svg%3E)
byzantium
20
Reputation points
commented 2024-10-14T06:09:06.7766667+00:00
PRADEEPCHEEKATLA
90,501
Reputation points