Error When Creating Managed AirFlow in Azure Data Factory

Question

I attempted to create a Managed AirFlow environment in Azure Data Factory, but I encountered the following error:

"Failed to save Airflow1. Error: Failed to save integration runtime. Airflow IR creation is not allowed. Please create new Data workflows for your Apache Airflow needs in Microsoft Fabric. It offers a wider range of Apache Airflow capabilities and enhanced features to better serve your needs."

Can anyone help me understand why this error occurred and what steps I should take to resolve it? Is Microsoft Fabric the only option now for creating AirFlow workflows?

Answer 1

Hi @Ahwan Mishra
Thank you for the question and using Microsoft Q&A platform.
The error you're encountering suggests that Azure Data Factory is no longer supporting new Managed Apache Airflow integration runtime environments. Instead, Microsoft is directing users toward Microsoft Fabric for creating and managing Apache Airflow workflows.

Microsoft Fabric has integrated Apache Airflow capabilities and offers additional features and flexibility compared to ADF's Managed Airflow, such as enhanced scalability, better performance, and tighter integration with other Microsoft services. It seems that Microsoft is gradually transitioning users from Azure Data Factory's Airflow environment to Fabric for managing workflows.

To resolve this issue, you can:

1. Explore Microsoft Fabric: Set up a new Apache Airflow workflow environment within Microsoft Fabric, where you'll find more advanced features and broader support for workflow automation.
2. Migrate existing workflows: If you already have Airflow workflows in ADF, you might need to migrate those workflows to Fabric to take advantage of the enhanced capabilities.

For more information you can refer to the below links:
https://blog.fabric.microsoft.com/en-us/blog/introducing-data-workflows-in-microsoft-fabric/
https://learn.microsoft.com/en-us/fabric/data-factory/data-workflows-migrate-azure-workflow-orchestration-manager
https://learn.microsoft.com/en-us/fabric/data-factory/data-workflows-hello-world

Hope this helps. Do let us know if you any further queries.

---

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.