Kusto table not being detected by ADF Copy Data activity

Question

Hello,
I am creating a pipeline in Azure Data Factory that uses a Scope activity to generate some data and uses a Copy Data activity to push that data to Kusto. I manually created a table in Azure Data Explorer with the Schema alongside a new dataset as well, but this table is not being detected in my Copy Data activity or in my dataset itself.

I get this error when I try to search for the table in the copydata "Caller is not authorized to perform this action Principal 'aaduser=xxxxx' is not authorized to read database 'databaseName'."

I created a previous table and dataset, and it could be detected (still is) but for some reason this new table is not being detected whereas they were all created the same way, and all other configurations (and permissions, as far as I know) are the same - except dataset

I have refreshed, deleted and recreated the table and dataset but still nothing. If someone can please advise on how to solve this issue, that will be greatly appreciated.

Answer 1

@Feria Nji - I'm glad that you were able to resolve your issue and thank you for posting your solution so that others experiencing the same thing can easily reference this! Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others ", I'll repost your solution in case you'd like to accept the answer .

Ask: Kusto table not being detected by ADF Copy Data activity

Solution: The issue is resolved. Thanks to all your suggestions I did go back and check the permissions and while I had all the right permissions, the data explorer endpoint (i.e cluster) I was using in my linked service was different from the one where I was actually creating the table. I am relatively new to Data Explorer so I don't know how I got to using a different cluster in data explorer but thanks to you all I was able to figure this out.

If I missed anything please let me know and I'd be happy to add it to my answer, or feel free to comment below with any additional information.

If you have any other questions, please let me know. Thank you again for your time and patience throughout this issue.

---

Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.

Answer 2

Thanks to all your suggestions I did go back and check the permissions and while I had all the right permissions, the data explorer endpoint (i.e cluster) I was using in my linked service was different from the one where I was actually creating the table.
I am relatively new to Data Explorer so I don't know how I got to using a different cluster in data explorer but thanks to you all I was able to figure this out.