Event ID 5121 — Cluster Shared Volume Functionality
Applies To: Windows Server 2008 R2
In a failover cluster, virtual machines can use Cluster Shared Volumes that are on the same LUN (disk), while still being able to fail over (or move from node to node) independently of one another. Virtual machines can use a Cluster Shared Volume only when communication between the cluster nodes and the volume is functioning correctly, including network connectivity, access, drivers, and other factors.
Event Details
Product: | Windows Operating System |
ID: | 5121 |
Source: | Microsoft-Windows-FailoverClustering |
Version: | 6.1 |
Symbolic Name: | DCM_VOLUME_NO_DIRECT_IO_DUE_TO_FAILURE |
Message: | Cluster Shared Volume '%1' ('%2') is no longer directly accessible from this cluster node. I/O access will be redirected to the storage device over the network through the node that owns the volume. This may result in degraded performance. If redirected access is turned on for this volume, please turn it off. If redirected access is turned off, please troubleshoot this node's connectivity to the storage device and I/O will resume to a healthy state once connectivity to the storage device is reestablished. |
Resolve
CSV - Check storage and network configuration
If you do not currently have Event Viewer open, see "Opening Event Viewer and viewing events related to failover clustering." If the event contains an error code that you have not yet looked up, see "Finding more information about error codes that some event messages contain." After reviewing event messages, choose actions that apply to your situation:
- Check the condition and configuration of the disks in Cluster Shared Volumes. For more information, see "Gathering information about the condition and configuration of a disk in Cluster Shared Volumes."
- Review network settings. For more information, see "Verifying settings for a network designated for network communication with Cluster Shared Volumes."
- Review security policies that might affect communication with Cluster Shared Volumes. For more information, see "Verifying that the required NTLM authentication is allowed."
To perform the following procedures, you must be a member of the local Administrators group on each clustered server, and the account you use must be a domain account, or you must have been delegated the equivalent authority.
Gathering information about the condition and configuration of a disk in Cluster Shared Volumes
To gather information about the condition and configuration of a disk in Cluster Shared Volumes:
- Scan appropriate event logs for errors that are related to the disk.
- Review information available in the interface for the storage and if needed, contact the vendor for information about the storage.
- To open the failover cluster snap-in, click Start, click Administrative Tools, and then click Failover Cluster Manager. If the User Account Control dialog box appears, confirm that the action it displays is what you want, and then click Yes.
- In the Failover Cluster Manager snap-in, expand the console tree and click Cluster Shared Volumes. In the center pane, expand the listing for the volume that you are gathering information about. View the status of the volume.
- Still in the center pane, to prepare for testing a disk in Cluster Shared Volumes, right-click the disk, click Take this resource offline, and then if prompted, confirm your choice. Repeat this action for any other disks that you want to test.
- Right-click the cluster containing the Cluster Shared Volumes, and then click Validate This Cluster.
- On the Testing Options page, select Run only tests I select.
- On the Test Selection page, clear the check boxes for System Configuration and Network. This leaves the tests for Cluster Configuration, Inventory, and Storage. You can run all these tests, or you can select only the specific tests that appear relevant to your situation.
- Follow the instructions in the wizard to run the tests.
- On the Summary page, click View Report.
- Under Results by Category, click Storage, click any test that is not labeled as Success, and then view the results.
- Scroll back to the top of the report, and under Results by Category, click Cluster Configuration, and then click List Cluster Network Information. Confirm that any network that you intend for communication between nodes and Cluster Shared Volumes is labeled either Internal use or Internal and client use. Confirm that other networks (for example, networks used only for iSCSI and not for cluster network communication) do not have these labels.
- If the information in the report shows that one or more networks are not configured correctly, return to the Failover Cluster Manager snap-in and expand Networks. Right-click the network that you want to modify, click Properties, and then make sure that the settings for Allow the cluster to use this network and Allow clients to connect through this network are configured as intended.
- To bring disks back online, click Cluster Shared Volumes and, in the center pane, right-click a disk, and then click Bring this resource online. Repeat this action for any other disks that you want to bring online again.
Verifying settings for a network designated for network communication with Cluster Shared Volumes
To verify settings for a network designated for network communication with Cluster Shared Volumes:
- Click Start, click Control Panel, click Network and Internet, and then click Network and Sharing Center.
- In the Tasks pane, click Change adapter settings.
- Right-click the connection you want, and then click Properties.
- Make sure that the following check boxes are selected:
- Client for Microsoft Networks
- File and Printer Sharing for Microsoft Networks
Verifying that the required NTLM authentication is allowed
- On a node in the cluster, to see the security policies that are in effect locally, click Start, click Administrative Tools, and then click Local Security Policy.
- Navigate to Security Settings\Local Policies\Security Options.
- In the center pane, click the Policy heading to sort the policies alphabetically.
- Review Network security: Restrict NTLM: Add remote server exceptions for NTLM authentication and the items that follow it. If items related to "server exceptions" are marked Disabled, or other items have specific settings, a policy may be in place that is interfering with NTLM authentication on this server. If this is the case, contact an appropriate administrator (for example, your administrator for Active Directory or security) to ensure that NTLM authentication is allowed for cluster nodes that are using Cluster Shared Volumes.
Opening Event Viewer and viewing events related to failover clustering
To open Event Viewer and view events related to failover clustering:
- If Server Manager is not already open, click Start, click Administrative Tools, and then click Server Manager. If the User Account Control dialog box appears, confirm that the action it displays is what you want, and then click Yes.
- In the console tree, expand Diagnostics, expand Event Viewer, expand Windows Logs, and then click System.
- To filter the events so that only events with a Source of FailoverClustering are shown, in the Actions pane, click Filter Current Log. On the Filter tab, in the Event sources box, select FailoverClustering. Select other options as appropriate, and then click OK.
- To sort the displayed events by date and time, in the center pane, click the Date and Time column heading.
Finding more information about the error codes that some event messages contain
To find more information about the error codes that some event messages contain:
- View the event, and note the error code.
- Look up more information about the error code in one of two ways:
Search System Error Codes (https://go.microsoft.com/fwlink/?LinkId=83027).
Click Start, point to All Programs, click Accessories, click Command Prompt, and then type:
NET HELPMSG errorcode
Verify
Confirm that the Cluster Shared Volume can come online. If there have been recent problems with writing to the volume, it can be appropriate to monitor event logs and monitor the function of the corresponding clustered virtual machine, to confirm that the problems have been resolved.
To perform the following procedures, you must be a member of the local Administrators group on each clustered server, and the account you use must be a domain account, or you must have been delegated the equivalent authority.
Confirming that a Cluster Shared Volume can come online
To confirm that a Cluster Shared Volume can come online:
- To open the failover cluster snap-in, click Start, click Administrative Tools, and then click Failover Cluster Manager. If the User Account Control dialog box appears, confirm that the action it displays is what you want, and then click Yes.
- In the Failover Cluster Manager snap-in, if the cluster you want to manage is not displayed, in the console tree, right-click Failover Cluster Manager, click Manage a Cluster, and then select or specify the cluster that you want.
- If the console tree is collapsed, expand the tree under the cluster you want to manage, and then click Cluster Shared Volumes.
- In the center pane, expand the listing for the volume that you are verifying. View the status of the volume.
- If a volume is offline, to bring it online, right-click the volume and then click Bring this resource online.
Using a Windows PowerShell command to check the status of a resource in a failover cluster
To use a Windows PowerShell command to check the status of a resource in a failover cluster:
On a node in the cluster, click Start, point to Administrative Tools, and then click Windows PowerShell Modules. If the User Account Control dialog box appears, confirm that the action it displays is what you want, and then click Yes.
Type:
Get-ClusterSharedVolume
If you run the preceding command without specifying a resource name, status is displayed for all Cluster Shared Volumes in the cluster.