Apache spark pool 3.3 deprecating but synapse link for dataverse is only supporting 3.3 version

Question

I am trying to create a synapse link for dataverse for the D365FO data export , since the delta lake conversion is mandatory for F&O data I have tried creating a apache spark pool 3.4 version in synapse but it was not showing in the drop down while configuring the synapse link , when I tried with 3.3 version is has shown , since 3.3 is deprecating end on next year , is it feasible to use it or is there any other solution for this .

Answer 1

Hi Athira Reghuraman,

Thanks for reaching out to Microsoft Q&A.

You're correct that Azure Synapse Runtime for Apache Spark 3.3 is scheduled for end of support on March 31, 2025. It's advisable to transition to Azure Synapse Runtime for Apache Spark 3.4, which is now generally available.

Regarding Azure Synapse Link for Dataverse, it currently supports Apache Spark 3.3. If you're unable to select Spark 3.4 during configuration, it may indicate that support for this version is not yet implemented.

Recommended Actions:

1. Consult Official Documentation: Regularly review the Azure Synapse Link for Dataverse documentation for updates on supported Spark versions.

Engage with Microsoft Support: Reach out to Microsoft Support or your Azure account representative to inquire about the roadmap for Spark 3.4 support in Azure Synapse Link for Dataverse.

Plan for Migration: If Spark 3.4 support is forthcoming, prepare to migrate your workloads accordingly. If not, consider alternative solutions or workarounds in collaboration with Microsoft Support.

By proactively addressing this transition, you can ensure the continuity and supportability of your data export processes from Dynamics 365 Finance and Operations.

Please feel free to click the 'Upvote' (Thumbs-up) button and 'Accept as Answer'. This helps the community by allowing others with similar queries to easily find the solution.