Share via

Can Data factory do automated data discovery

Hamid, Faheem (IT) 21 Reputation points
2020-07-20T13:23:50.627+00:00

Can Data factory do automated data discovery ?

Definition: Data discovery is the collection and analysis of data from various sources to gain insight from hidden patterns and trends. It is the first step in fully harnessing an organization’s data to inform critical business decisions. Through the data discovery process, data is gathered, combined, and analyzed in a sequence of steps.

Clearly it can do support most of those steps when set up with an end goal in mind - but is there any automation possibel.

Thanks

F

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,176 questions
0 comments
Accepted answer
  1. Vaibhav Chaudhari 38,806 Reputation points
    2020-07-20T13:57:20.75+00:00

    I don't think there is any in-built ADF activity which does the Data discovery job. ADF is the orchestration tool on Azure.

    Probably, write a solution in PowerShell, Python, .Net and run it via Data factory - Custom activity, Azure function activity.

    Or maybe load data to Azure SQL DB and enable the Data discovery and classification feature.

    Azure SQL - data-discovery-and-classification-overview

    ----------

    If the response helped, do "Accept Answer" and upvote it -- Vaibhav

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful
Most helpful Newest Oldest

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.