You cannot create an auth provider but it is still supported to use MFA Server with RDG. MFA is per user licensing now, rather than auth providers. An Azure MFA Auth provider is used to take advantage of the features provided by Azure MFA for users who do not have licenses.
You do need either a Premium P1 or P2 license because MFA is sold as part of those licenses. New customers may no longer purchase Azure Multi-Factor Authentication as a standalone offering effective September 1st, 2018. Multi-factor authentication MFA will continue to be an available feature in Azure AD Premium License. You get a subset of features in Office 365 subscriptions with MFA.
It is full MFA or nothing going forward. If you have an authentication provider you can keep using it but you cannot create any new ones, even with the Premium license.