how to sink data to storage in one file ?

Ahmed Assad 266

i am use azure iot hub service sdk to authT ESP 8266 device with azure iot hub and then route data to blob storage ,
after it sink data from device to storage ... i found all data divided by folder based on data and time as it described in image

what is the solution of this problem, to sink continuous telemetries in the same file ?
or what iis the right option to select storage type ?

AshokPeddakotla-MSFT 35,096 Reputation points

2021-02-09T14:19:35.6+00:00

@AhmedAssad-8581
1/2
To provide more context, IoT Hub batches messages and writes data to storage whenever the batch reaches a certain size or a certain amount of time has elapsed. IoT Hub defaults to the following file naming convention:

{iothub}/{partition}/{YYYY}/{MM}/{DD}/{HH}/{mm}

You can set the format of the blob name using the Blob file name format. The default is {iothub}/{partition}/{YYYY}/{MM}/{DD}/{HH}/{mm}. The format must contain {iothub}, {partition}, {YYYY}, {MM}, {DD}, {HH}, and {mm} in any order.

IoT Hub will write to an empty blob if there is no data to write. We recommend listing the blobs or files and then iterating over them, to ensure all blobs or files are read without making any assumptions of partition. The partition range could potentially change during a Microsoft-initiated failover or IoT Hub manual failover.
AshokPeddakotla-MSFT 35,096 Reputation points

2021-02-09T14:19:44.677+00:00

2/2

Regarding your specific query,

what is the solution of this problem, to sink continuous telemetries in the same file ?
or what iis the right option to select storage type ?

Let me check if there is any way.
Ahmed Assad 266 Reputation points

2021-02-09T15:03:36.217+00:00

i am sorry , i do not know another way to sink all data in same file without more paths
So in case you know any way told me please
AshokPeddakotla-MSFT 35,096 Reputation points

2021-02-18T16:21:35.793+00:00

@AhmedAssad-8581
Just checking in to see if the below answer(s) helped.
If an answer is helpful, please "Accept answer" or "Up-Vote" for the same which might be beneficial to other community members reading this thread.

1 answer

AshokPeddakotla-MSFT 35,096 Reputation points

2021-02-15T16:46:43.167+00:00

@AhmedAssad-8581 Sorry for the delay in response. As mentioned earlier, The default file name format is {iothub}/{partition}/{YYYY}/{MM}/{DD}/{HH}/{mm}. The format must contain {iothub}, {partition}, {YYYY}, {MM}, {DD}, {HH}, and {mm} in any order.

As an alternative, to customize the filename format, you can write an Azure Function which triggers for new IoT hub messages and store the data in an Azure Blob Storage Container.

I would suggest you go through the documentation on How to use Azure Functions with IoT Hub message routing and Azure IoT Hub bindings for Azure Functions for more details. Please let us know if you need further help or any queries.
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

how to sink data to storage in one file ?

1 answer

Your answer