Connection reset upon receiving an SMB 3.1.1 encrypted packet.

立軒 林 20 Reputation points
2023-12-15T07:04:23.5433333+00:00

Hello, everyone.

I am currently working on an SMB client on an embedded RTOS system. When the test servers( Windows 11 & Windows 10) received the encrypted SMB packet from the client, Windows immediately fails the request with a [RST ,ACK] .

I only use the AES-128-CCM encryption algorithm after confirmed in the negotiation response from server, and cross-testing with other conventional application(SAMBA server with my client, 3rd-party client with test servers) all works with no problem, really cannot find obvious clue about the cause of this.

Windows 10 Network
Windows 10 Network
Windows 10: A Microsoft operating system that runs on personal computers and tablets.Network: A group of devices that communicate either wirelessly or via a physical connection.
2,364 questions
Windows Open Specifications
Windows Open Specifications
Windows: A family of Microsoft operating systems that run across personal computers, tablets, laptops, phones, internet of things devices, self-contained mixed reality headsets, large collaboration screens, and other devices.Open Specifications: Technical documents for protocols, computer languages, standards support, and data portability. The goal with Open Specifications is to help developers open new opportunities to interoperate with Windows, SQL, Office, and SharePoint.
42 questions
Windows Network
Windows Network
Windows: A family of Microsoft operating systems that run across personal computers, tablets, laptops, phones, internet of things devices, self-contained mixed reality headsets, large collaboration screens, and other devices.Network: A group of devices that communicate either wirelessly or via a physical connection.
779 questions
Windows Server Storage
Windows Server Storage
Windows Server: A family of Microsoft server operating systems that support enterprise-level management, data storage, applications, and communications.Storage: The hardware and software system used to retain data for subsequent retrieval.
656 questions
Windows 11
Windows 11
A Microsoft operating system designed for productivity, creativity, and ease of use.
10,013 questions
{count} votes

Accepted answer
  1. Obaid Farooqi MSFT 591 Reputation points Microsoft Employee
    2024-01-08T22:09:31.9833333+00:00

    This issue is now resolved.

    The reason server was disconnecting is that the implementor is using port 139 which is Netbios-over-TCP. Windows client and server do not support encryption on Netbios-over-TCP. This is documented in MS-SMB2 as follows:

    "

    <90> Section 3.1.4.3: Windows-based clients and servers do not encrypt the message if the connection is NetBIOS over TCP

    "

    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.