Is there a way to automate file transfer from a Storage Account to Azure DevOps Repo?

Question

Is there a way to automate file transfer from a Storage Account to Azure DevOps Repo?

Thank you,

Answer 1

Hi @Shinobi ,

Easy. It depends what option is better for you.

For example, I'm quite familiar with Powershell, I prefer to use Azure Services supporting this scripting language natively, for example Azure Automation Account or Azure Function Apps.
Additionally, Azure DevOps has Pipelines and ADO can transfer files from a storage account to Azure DevOps Repo by itself.

Decision in your hands

Answer 2

@Shinobi Adding to the above answer....

Please refer to this document for more details regarding - Solutions for periodic data transfer

Here are some options-

Scripted/programmatic tools – For data transfer that occurs at regular intervals, use the scripted and programmatic tools such as AzCopy and Azure Storage REST APIs. These tools are targeted towards IT professionals and developers.

AzCopy - Use this command-line tool to easily copy data to and from Azure Blobs, Files, and Table storage with optimal performance. AzCopy supports concurrency and parallelism, and the ability to resume copy operations when interrupted.
Azure Storage REST APIs/SDKs – When building an application, you can develop the application against Azure Storage REST APIs and use the Azure SDKs offered in multiple languages. The REST APIs can also leverage the Azure Storage Data Movement Library designed especially for the high-performance copying of data to and from Azure.

Continuous data ingestion tools – For continuous, ongoing data ingestion, you can select one of the following options.

Object replication - Object replication asynchronously copies block blobs between containers in a source and destination storage account. Use object replication as a solution to keep containers in two different storage accounts in sync.
Azure Data Factory – Data Factory should be used to scale out a transfer operation, and if there is a need for orchestration and enterprise grade monitoring capabilities. Use Azure Data Factory to set up a cloud pipeline that regularly transfers files between several Azure services, on-premises, or a combination of the two. Azure Data Factory lets you orchestrate data-driven workflows that ingest data from disparate data stores and automate data movement and data transformation.
Azure Data Box family for online transfers - Data Box Edge and Data Box Gateway are online network devices that can move data into and out of Azure. Data Box Edge uses artificial intelligence (AI)-enabled Edge compute to pre-process data before upload. Data Box Gateway is a virtual version of the device with the same data transfer capabilities.

Hope this helps. If you need any further information about any specific service, please do let us know and we will be glad to assist further. Thank you@
Remember:

Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.

Want a reminder to come back and check responses? Here is how to subscribe to a notification.