Extract data from SQL Database table and insert into Elasticsearch Particular index

Question

Hi Team,

I have SQL Database, from that i have to retrieve some tables data using query and insert resulted data in elasticsearch particular index. Please suggest how can it possible through Azure Data Factory ?

Answer 1

Hello @Priti Bhangale

Thanks for the using the new forum .

It appears that you have the data in SQL and you are plannig to write that to ES using the API . The copy activity cannot be used as the in our case the sink will be http or REST and they are not supported as sink but only as source .

Please read on this here :https://learn.microsoft.com/en-us/azure/data-factory/copy-activity-overview

You didn't mentioned where is ES instance is hosted , if its on the public internet you can use lookup activity and web acticvity , if its on the local network , web activity cannot be used .

https://learn.microsoft.com/en-us/azure/data-factory/control-flow-web-activity

Please let me know if you have any further queries .

----------

Thanks Himanshu

Please do consider to click on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members