How to reference to an unpublished notebook in a pipeline in synapse

Question

Hi,

I have a similar question to the post here which does not seem to be resolved:

https://learn.microsoft.com/en-us/answers/questions/1048735/synapse-how-to-run-pipeline-(-call-notebook)-witho?page=1&orderby=Helpful&comment=answer-1074143#newest-answer-comment

Similar what is explained in the post above, I am trying to run Pipeline1 in the debug mode in a feature branch. Notebooks1 and Notebooks2 are new in the feature branch and as such, not published. I have both notebooks "unpublished notebooks reference" enabled.

Notebook2 references Notebook1 using %run command. When I run Notebook2, it runs with no issues. But when I simply add Notebook2 to my newly created pipeline, Pipeline1, it can no longer reference to Notebook1 and complains about the Notebook1 not existing.

Is there any solutions to this ?

Thanks !

Answer 1

Hi Kobra Alizadeh ,

I got the response from the team.

"Currently running unpublished notebook as notebook activity in pipeline is not support on Synapse, but reference running unpublished notebook in another notebook is supported . It’s by design."

Appreciate if you could share the feedback on our Azure Synapse feedback channel, which would be open for the user community to upvote & comment on. This allows our product team to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

Kindly accept the answer by clicking on Accept answer button. Thankyou

Answer 2

@Kobra Alizadeh

Go to the Notebook Properties and click on the checkbox (Enable unpublished notebook reference).

Hope that helps