I'd recommend using ExO PowerShell for any Exchange-related properties, the Graph implementation is flaky at best. And the Graph SDK for PowerShell adds a layer of autogenerated crap on top of that, it ain't pretty.
If for some reason you must use the Graph SDK for PowerShell, this should work:
Invoke-MgGraphRequest -Uri 'https://graph.microsoft.com/v1.0/groups/efc8f64f-a605-4f39-85ca-d78350b8765d/acceptedSenders/$ref?$id=https://graph.microsoft.com/v1.0/users/xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx' -Method DELETE
Where you must provide the id of the object to remove. Do note the use of single quotes.
If the object you with to remove from the accepted senders list is not a user, replace the corresponding reference:
Invoke-MgGraphRequest -Uri 'https://graph.microsoft.com/v1.0/groups/efc8f64f-a605-4f39-85ca-d78350b8765d/acceptedSenders/$ref?$id=https://graph.microsoft.com/v1.0/groups/xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx' -Method DELETE