Hi CUIJPERS Gerard,
Welcome to the Microsoft Q&A Platform. Thank you for posting a detailed question here.
Given the error mentioned, it appears that the deletion process is being blocked on the backend. You will need to submit a support request to remove the subnet delegation and delete the Virtual Network. If you have a support plan, please file a support ticket. If you do not have a support plan and need assistance with one-time free technical support, please let us know.
Refer to how create support ticket: How to create an Azure support request - Azure supportability | Microsoft Learn
Another likely cause of this issue might be "When you remove the last gateway associated to a gateway/subnet, it might take up to 48-72 hours before you can delete the subnet or VNet."
Refer this documentation
Similar issue: https://learn.microsoft.com/en-us/answers/questions/1290926/cannot-delete-subnet-delegated-to-microsoft-powerp
Please "Accept the answer" if the information helped you. This will help us and others in the community as well.