How to Auto scale the VMSS based on File share file count.

VahindeGanesh-4593 0

We have a requirement to auto scale the VMSS instances based on the file share file count.

the file count in Azure file share is getting to update whenever the user imports the file.

I need a solution or approach how achieve to autoscale the VMSS instances.

Thank you

KarishmaTiwari-MSFT 20,217 Reputation points Microsoft Employee

2023-03-02T08:20:17.4133333+00:00

Hello Vahinde, Ganesh , If you still have questions, please let us know in the "comments" and we would be happy to help you.

If the reply below has been helpful, we appreciate hearing from you and would love to help others who may have the same question. Accepting answers helps increase visibility of this question for other members of the Microsoft Q&A community.

Thank you for helping to improve Microsoft Q&A!

1 answer

TP 99,926 Reputation points

2023-02-21T21:42:34.42+00:00

Hi,

Have you explored creating custom scaling rule based on metric and then selecting storage account -- files -- file count, etc., with the condition(s) and options for increasing/decreasing instances? I know the metric for file count is an option, however, I've never used it as a metric to scale VMSS.

Under what specific circumstances/conditions do you want to scale out/in? If you explain in more detail it would be helpful to me to recommend a more specific approach. Otherwise what I can recommend is experimenting with the scaling in the portal with the metric(s) you are considering and then based on that ask additional questions in a comment.

-TP
Please sign in to rate this answer.
VahindeGanesh-4593 0 Reputation points

2023-02-22T05:35:53.94+00:00

Thanks for you responce.

Allow me to explain the situation.

We have an application that processes documents for OCR, and these documents/files are imported into the Azure files folder via the application's.

Now, when a user imports a large number of documents/files, which he does at the beginning of each month, the documents are processed.

So based on this we wanted to Scale out/in VMSS instances

TP 99,926 Reputation points

2023-02-22T13:06:55.5566667+00:00

Hi @VahindeGanesh-4593 Okay, thanks for explaining, that helps.

After processing the documents, do you move them to different file share? If you are basing the scaling rules on count of files moving the files out would be necessary so that the file count decreases and thus allows the scale set to scale in.

Is the processing of the documents time sensitive? Do you need to have at least one instance running 24x7 or is it okay for instances to be stopped during the rest of the month?

Since you wrote this I ran some tests using the Storage account -- File -- File Count metric, and so far it doesn't seem to be the best for your use case. First potential issue, I added files to the test share and it took more time than I expected for the metric to update. Second, it is Average, so although you could work with that it is not ideal for VMSS scale out/in rule.

What do you think of having a script run periodically (say every xx minutes) that checks the share to see current file count and then react? For example, if it finds large number of files, run command to trigger manual scale out of your VMSS, else if it finds zero files, run command to trigger manual scale in of your VMSS.

TP 99,926 Reputation points

2023-02-23T22:02:19.54+00:00

@Vahinde, Ganesh Any progress?

TP 99,926 Reputation points

2023-02-28T21:37:18.94+00:00

Hi @Vahinde, Ganesh Any update? Please remember to click Accept Answer to close up this thread or leave a comment if you need additional help.

Thank you.
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

How to Auto scale the VMSS based on File share file count.

1 answer

Your answer