Hi @Saladi, Pushpa L,
This is an expected behavior. If you are using a link to the video, it will be opened in a new window. You should store the file in sharepoint document library.
After adding the items from Documents, I could play the video in the page.
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.