Can I connect to a databricks table and pull data directly into AAS for our daily data refresh (processing)

George Matlhogela 20 Reputation points
2024-09-25T11:07:04.0333333+00:00

I want to connect to databricks tables directly using azure analysis services (AAS) and pull data into our AAS model during our daily model processing.

Azure Analysis Services
Azure Analysis Services
An Azure service that provides an enterprise-grade analytics engine.
465 questions
{count} votes

Accepted answer
  1. Amira Bedhiafi 27,446 Reputation points
    2024-09-25T20:52:11.2733333+00:00

    As of now, Azure Analysis Services (AAS) does not provide a built-in connector for Databricks. However, you can still integrate data from Azure Databricks into AAS by utilizing intermediate steps, such as:

    1. Exporting Databricks Data to Azure SQL Database or Azure Synapse:
      • One common approach is to load data from Databricks into an Azure SQL Database or Azure Synapse Analytics. You can then connect AAS to this data source and schedule regular processing.
    2. Using Azure Data Factory (ADF):
      • ADF can orchestrate the movement of data from Databricks to other supported sources such as Azure Blob Storage, Azure Data Lake, Azure SQL Database, or Azure Synapse. Once the data is stored, AAS can pull it from those sources.
    3. Power BI and Direct Query:
      • If your goal is more focused on real-time data, consider using Power BI with Direct Query mode, which supports Databricks as a data source. You can either import the data into Power BI and then load it into AAS or create a direct query model that AAS can leverage.

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.