How to configure late arrival policy to handle events that arrive later than configured tolerance window

Question

I want to configure a late arrival policy and increase the tolerance of my Stream Analytics.

While I can see documentation explaining late arrival policies (https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-time-handling?wt.mc_id=knwlserapi_inproduct_azportal#side-effects-of-event-ordering-time-tolerances), there is not exact guidance to do so. How do I add a late arrival policy to my resource to make sure that it handles late events appropriately?

Answer 1

Hi @Annie Zhou
Thanks for the question and using MS Q&A platform.

To configure a late arrival policy in Azure Stream Analytics, you need to set the late arrival tolerance value in your Stream Analytics job configuration. This policy determines how late an event can arrive before it is either dropped or its event time is adjusted.

Access your Stream Analytics job - Go to the Azure portal and navigate to your Stream Analytics job.

Locate the event ordering settings - In the job settings, find the section for event ordering policies.

Set the late arrival policy -You can specify the late arrival tolerance in seconds. For example, if you want to increase the tolerance to 15 seconds, set the late arrival policy to 15 seconds. The default is 5 seconds.

Save your changes - Ensure you save the configuration changes to apply the new late arrival policy.

With this configuration, any event that arrives later than the specified tolerance will either be dropped or have its event time adjusted according to your settings.

For more details refer to this: Configuring event ordering policies for Azure Stream Analytics

Understand time handling in Azure Stream Analytics

Hope this helps. Do let us know if you have any further queries.