Help me decide between Azure data lake analytics and Azure Databricks

WeirdMan 260 Reputation points
2023-10-04T10:40:23.2033333+00:00

Both Azure Data Lake Analytics and Azure Databricks can be used for batch processing. Can you help me understand for which case we can use each one?

Azure Analysis Services
Azure Analysis Services
An Azure service that provides an enterprise-grade analytics engine.
458 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,218 questions
Azure Data Lake Analytics
0 comments No comments
{count} votes

Accepted answer
  1. Amira Bedhiafi 26,186 Reputation points
    2023-10-04T10:51:24.65+00:00

    Usually, the AZ Data Lake is used as a storage which is much cheaper compared to other tools and you can manage the jobs side via Databricks notebooks (we are talking here about running jobs with high-performance and in-memory clusters).

    Another detail Databricks has more languages options and it is dedicated to many backgrounds working with data.

    If you are dealing with complex batch process and you have different type of developers who will work on your project you may go for both( a Azure Data Lake + Databricks architecture). Otherwise you can use Azure Data Lake.

    Here are some links :

    https://www.element61.be/en/resource/when-use-azure-synapse-analytics-andor-azure-databricks

    https://visualbi.com/blogs/microsoft/azure/etl-azure-databricks-vs-data-lake-analytics/

    https://www.databricks.com/discover/data-lakes

    2 people found this answer helpful.
    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.