This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
I am getting an unspecified error when running UPDATE, DELETE and MERGE sql statements on Delta tables when using Spark SQL APIs. I can use Scala APIs fine, I’m wondering if anyone else is having the same issue?
You can see here that SQL based DML is mostly not supported in the LF version of Delta Lake, it will come in the future.
https://docs.delta.io/latest/quick-start.html#create-a-table
-Euan
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(134.4, 9%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
Hi @AndyCutler-3530 ,
Following up to see if the above info from @Euan Garden was helpful. If this answers your query, please do consider to click "accept the answer" and/or "Up-Vote" as it might be beneficial to other community members reading this thread. And, if you have any further query do let us know.
Hi @AndyCutler-3530 ,
Following up to see if the above info answers your query. If you have any further query do let us know.
Could some clarify - what is LF version here?
The Linux Foundation version of Delta Lake which is the OSS one as opposed to the one from Databricks
Ah OK thanks. So the SQL DML statements only work on Databricks at the moment.
A small subset do in LF but most do not.