Hello Hong,
Thank you for posting your query here!
As per the latest Azure File Sync release note, the agent is supported only on Windows Server 2019, Windows Server 2016, Windows Server 2012 R2, and Windows Server 2022.
So unfortunately, Azure File Sync Agent is not officially supported on Windows 11.
For further details: https://learn.microsoft.com/en-us/azure/storage/file-sync/file-sync-release-notes#agent-installation-and-server-configuration
For system requirements and installation instructions kindly refer: https://www.microsoft.com/en-us/download/details.aspx?id=57159
Please let us know if you have any further queries. I’m happy to assist you further.
Please do not forget to "Accept the answer” and “up-vote” wherever the information provided helps you, this can be beneficial to other community members.