Hello @Simon T,
welcome to this moderated Azure community forum.
Thank you for pointing this behavior out, it feels like this is not the proper functionality indeed.
I have contacted some friends at MSFT and hope to bring this message to the attention of the product team.
I will report back updates if available here.
If the response helped, do "Accept Answer". If it doesn't work, please let us know the progress. All community members with similar issues will benefit by doing so. Your contribution is highly appreciated.