Hi @rkreddy
Greetings & Welcome to Microsoft Q&A forum! Thanks for posting your query!
Please refer to the similar discussion thread in the Databricks community, as it might provide you with some valuable insights.
I hope this information helps. Please do let us know if you have any further queries.
Thank you.