Cluster storage disk online(No Access)

Nandal, Preeti 1 Reputation point
2020-11-02T12:32:24.313+00:00

Hi All,

We are using WS 2012 hyper-v running on clustered storage. The configuration was working fine for the last 4 years. Today morning 2 of the disks in cluster seems to have lost connection and can be seen as online(no Access). due to which VMs running on the are powered off and are on status failed. One of the volumes have disappeared from the clustered storage c drive and appears as a folder for 2 secs and disappears again.
Reading articles related, I can say that we do not have a DC as node.
Checked Iscsi connections and found that one of the hyper-v host has default as configurations(adapter and source IP under favourites).
Checked the Dell storage connections to the particular volume - which was optimal.Also checked it in the Disk management which was available.
Everything else with respect to the connections seems to be working just fine.
What else be verified or changed ?I have the whole production down.

Thanks.

Windows Server Clustering
Windows Server Clustering
Windows Server: A family of Microsoft server operating systems that support enterprise-level management, data storage, applications, and communications.Clustering: The grouping of multiple servers in a way that allows them to appear to be a single unit to client computers on a network. Clustering is a means of increasing network capacity, providing live backup in case one of the servers fails, and improving data security.
996 questions

2 answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. Xiaowei He 9,891 Reputation points
    2020-11-03T07:11:43.387+00:00

    Hi,

    1. Please check if we install McAfee antivirus or other third-party application on the cluster nodes, if yes, please uninstall the antivirus application.
    2. Please run Cluster validation wizard, check if there's any error about the storage in the report.
    3. Please check if the cluster nodes are up to date, if not, please install updates on the cluster nodes.

    Thanks for your time!
    Best Regards,
    Anne

    -----------------------------

    If the Answer is helpful, please click "Accept Answer" and upvote it.

    Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

    0 comments
  2. Nandal, Preeti 1 Reputation point
    2020-11-04T13:17:45.977+00:00

    Hi XioweiHe,

    I understand all the points that you have put forward

    1. We do have antivirus but uninstalling that would leave HV unattended. Is That really a solution?
    2. Cluster validation will bring down the whole environment (at least for an hour). Is there any other report or logs that I can check from the cluster ?
    3. Will installing the updates rectify the issue ? I think it would be a preventive measure rather than a corrective one.
      In addition to everything happening in few Hyper-v we are able to access the volume a see the content. Others Cannot event load contents from the cluster storage drive which is very confusing.
      We did run get-cluster logs and found the below events only for one of the affected disk.

    Line 509327: 00000b64.0000be64::2020/11/02-15:45:23.474 INFO [DCM] SubmitStateChangeNotification: generating notification for resource Cluster Disk 5
    Line 509329: 00000b64.0000be64::2020/11/02-15:45:23.482 INFO [DCM] GetCsvVolumeMountpoints: resource 'Cluster Disk 5' outBufSize 4096
    Line 509330: 00000b64.0000be64::2020/11/02-15:45:23.482 INFO [DCM] GetCsvVolumeMountpoints: resource 'Cluster Disk 5' not in MM \?\Volume{a07e198d-b12a-4f52-a205-e0b24132b0a0}\
    Line 509331: 00000b64.00008c4c::2020/11/02-15:45:23.482 INFO [DCM] GetCsvVolumeMountpoints: resource 'Cluster Disk 5' outBufSize 4096
    Line 509332: 00000b64.00008c4c::2020/11/02-15:45:23.482 INFO [DCM] GetCsvVolumeMountpoints: resource 'Cluster Disk 5' not in MM \?\Volume{a07e198d-b12a-4f52-a205-e0b24132b0a0}\
    Line 509333: 00000b64.0000be64::2020/11/02-15:45:23.482 INFO [DCM] GetCsvVolumeMountpoints: resource 'Cluster Disk 5' partition '2' returns 56 bytes and status 0
    Line 509334: 00000b64.00008c4c::2020/11/02-15:45:23.482 INFO [DCM] GetCsvVolumeMountpoints: resource 'Cluster Disk 5' partition '2' returns 56 bytes and status 0
    Line 509335: 00000b64.0000ed38::2020/11/02-15:45:23.483 INFO [DCM] GetCsvVolumeMountpoints: resource 'Cluster Disk 5' outBufSize 4096
    Line 509336: 00000b64.00008c4c::2020/11/02-15:45:23.483 INFO [DCM] GetCsvVolumeMountpoints: resource 'Cluster Disk 5' outBufSize 4096
    Line 509337: 00000b64.0000be64::2020/11/02-15:45:23.483 INFO [DCM] GetCsvVolumeMountpoints: resource 'Cluster Disk 5' outBufSize 4096
    Line 509338: 00000b64.00008c4c::2020/11/02-15:45:23.483 INFO [DCM] GetCsvVolumeMountpoints: resource 'Cluster Disk 5' not in MM \?\Volume{a07e198d-b12a-4f52-a205-e0b24132b0a0}\
    Line 509339: 00000b64.0000ed38::2020/11/02-15:45:23.483 INFO [DCM] GetCsvVolumeMountpoints: resource 'Cluster Disk 5' not in MM \?\Volume{a07e198d-b12a-4f52-a205-e0b24132b0a0}\
    Line 509340: 00000b64.0000be64::2020/11/02-15:45:23.483 INFO [DCM] GetCsvVolumeMountpoints: resource 'Cluster Disk 5' not in MM \?\Volume{a07e198d-b12a-4f52-a205-e0b24132b0a0}\
    Line 509341: 00000b64.000060d8::2020/11/02-15:45:23.483 INFO [DCM] GetCsvVolumeMountpoints: resource 'Cluster Disk 5' outBufSize 4096
    Line 509342: 00000b64.000060d8::2020/11/02-15:45:23.483 INFO [DCM] GetCsvVolumeMountpoints: resource 'Cluster Disk 5' not in MM \?\Volume{a07e198d-b12a-4f52-a205-e0b24132b0a0}\
    Line 509343: 00000b64.0000b7b0::2020/11/02-15:45:23.483 INFO [DCM] GetCsvVolumeMountpoints: resource 'Cluster Disk 5' outBufSize 4096
    Line 509344: 00000b64.0000b7b0::2020/11/02-15:45:23.483 INFO [DCM] GetCsvVolumeMountpoints: resource 'Cluster Disk 5' not in MM \?\Volume{a07e198d-b12a-4f52-a205-e0b24132b0a0}\
    Line 509345: 00000b64.00008c4c::2020/11/02-15:45:23.483 INFO [DCM] GetCsvVolumeMountpoints: resource 'Cluster Disk 5' partition '2' returns 56 bytes and status 0
    Line 509346: 00000b64.0000ed38::2020/11/02-15:45:23.483 INFO [DCM] GetCsvVolumeMountpoints: resource 'Cluster Disk 5' partition '2' returns 56 bytes and status 0
    Line 509347: 00000b64.0000be64::2020/11/02-15:45:23.483 INFO [DCM] GetCsvVolumeMountpoints: resource 'Cluster Disk 5' partition '2' returns 56 bytes and status 0
    Line 509348: 00000b64.000060d8::2020/11/02-15:45:23.483 INFO [DCM] GetCsvVolumeMountpoints: resource 'Cluster Disk 5' partition '2' returns 56 bytes and status 0
    Line 509349: 00000b64.0000b7b0::2020/11/02-15:45:23.483 INFO [DCM] GetCsvVolumeMountpoints: resource 'Cluster Disk 5' partition '2' returns 56 bytes and status 0
    Line 509352: 00000b64.0000d308::2020/11/02-15:45:24.938 INFO [DCM] PauseDisk completed on all nodes for resource 'Cluster Disk 5'
    Line 509357: 00001500.0000d2b4::2020/11/02-15:45:24.938 INFO [RES] Physical Disk <Cluster Disk 5>: GET_DISK_NUMBER - Resource is online
    Line 509358: 00001500.0000d2b4::2020/11/02-15:45:24.938 INFO [RES] Physical Disk <Cluster Disk 5>: GET_DISK_NUMBER: Disk number is 5
    Line 509367: 00000b64.0000d308::2020/11/02-15:45:24.940 INFO [DCM] PrepareMetadataVolumes: resource Cluster Disk 5, status 0
    Line 509368: 00001500.0000d2b4::2020/11/02-15:45:24.940 INFO [RES] Physical Disk <Cluster Disk 5>: GET_DISK_NUMBER - Resource is online
    Line 509369: 00001500.0000d2b4::2020/11/02-15:45:24.940 INFO [RES] Physical Disk <Cluster Disk 5>: GET_DISK_NUMBER: Disk number is 5
    Line 509379: 00000b64.00005dc4::2020/11/02-15:45:24.942 INFO [DCM] SyncHandler for Cluster Disk 5: action dcm/map, sequence 3:16057 (U2-HV4)
    Line 509380: 00001500.0000d2b4::2020/11/02-15:45:24.942 INFO [RES] Physical Disk <Cluster Disk 5>: GET_DISK_NUMBER - Resource is online
    Line 509381: 00001500.0000d2b4::2020/11/02-15:45:24.942 INFO [RES] Physical Disk <Cluster Disk 5>: GET_DISK_NUMBER: Disk number is 5
    Line 509404: 00000b64.00005dc4::2020/11/02-15:45:24.945 INFO [DCM] MapDisk completed for resource 'Cluster Disk 5'
    Line 509406: 00001500.0000d2b4::2020/11/02-15:45:30.279 INFO [RES] Physical Disk <Cluster Disk 5>: VolumeIsNtfs: Volume \?\GLOBALROOT\Device\Harddisk5\ClusterPartition2\ has FS type NTFS

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.