Do you means that you are limited by subscription quota so you need to delete one or more existing Public IPs to create a new one?
For the error to delete the old IP address, I believe it is still associated with a NIC so you are failed to delete. You need to dissociate it first, then you can delete the IP or just reassociate it to your new VM!