Hi @PR ,
Welcome to the Microsoft Q&A Platform! Thank you for asking your question here.
Directly configuring a RemoteApp session using just a URL is not supported. Remote app publish applications to stream remotely that are installed locally on session hosts or delivered dynamically using app attach and MSIX app attach and presented to users as individual applications in one of the supported Remote Desktop clients.
We would recommend developing a basic wrapper application that launches the desired URL in a web browser. This application can then be packaged into an MSIX file and installed on the session host. This method enables us to provide the web application via RemoteApp, while ensuring the session ends when the user closes the browser- Create an MSIX package with MSIX Core from source code
If you have any further queries, do let us know. If the answer is helpful, please click "Accept Answer" and "Upvote it."