@Jacob Gardner Not every ASP supports the Premium V2 instance, even if you're in a supported region. At this time, if you are unable to scale up to Premium V2, you will need to migrate your apps to a supported app service plan.
You'll need to create a new App Service Plan that by default uses Premium V2 in order to ensure you're given supported hardware. (After the creation is completed, you can still scale down to standard/basic/etc. but this will ensure you have the ability to scale up to Pv2 when needed.
From there, you'll need to clone your app(s) from the old App Service Plan into the new App Service Plan or manually migrate/deploy your apps to the new App Service Plan.