Previous  |  Next  >  
Product: Storage Foundation for Oracle RAC Guides   
Manual: Storage Foundation 4.1 for Oracle RAC Installation and Configuration   

Verifying Data Storage Arrays Using the vxfentsthdw Utility

You can use the vxfentsthdw utility to verify that shared storage arrays to be used for data support SCSI-3 persistent reservations and I/O fencing. The description in Chapter 3 shows how to use the testing utility to test a single disk. The utility has other options that may be more suitable for testing storage devices in other configurations.


Note   Note    Disks used as coordinator disks must also be tested. See Setting Up Coordinator Disks.

The utility, which you can run from one system in the cluster, tests the storage used for data by setting and verifying SCSI-3 registrations on the disk or disks you specify, setting and verifying persistent reservations on the disks, writing data to the disks and reading it, and removing the registrations from the disks. Refer also to the vxfentsthdw(1M) manual page.

General Guidelines for Using vxfentsthdw

  • The utility requires two systems connected to the shared storage.

  • Caution  Caution    The tests overwrite and destroy data on the disks, unless you use the -r option.
  • The two systems must have remsh permission set so that each node has root user access to the other. Temporarily modify the /.rhosts file to enable cluster communications for the vxfentsthdw utility, placing a "+ +" character in the first line of the file. You can also limit the remote access to specific systems. Refer to the manual page for the /.rhosts file for more information. See Removing remsh Permissions and Restoring Public Network Connections when you complete testing.
  • To ensure both systems are connected to the same disk during the testing, you can use the vxfenadm -i diskpath command to verify a disk's serial number. See Verifying the Nodes See the Same Disk.
  • For disk arrays with many disks, use the -m option to sample a few disks before creating a disk group and using the -g option to test them all.
  • When testing many disks with the -f or -g option, you can review results by redirecting the command output to a file.
  • The utility indicates a disk can be used for I/O fencing with a message resembling:

  •   The disk /dev/rdsk/c4t8d0s2 is ready to be configured for I/O 
      Fencing on node nebula
    If the utility does not show a message stating a disk is ready, verification has failed.
  • If the disk you intend to test has existing SCSI-3 registration keys, the test issues a warning before proceeding.

vxfentsthdw Options

The table below describes three methods the utility provides to test storage devices.

vxfentsthdw option Description When to Use

-m

Utility runs manually, in interactive mode, prompting for systems and devices, and reporting success or failure.

May be used with -r and -t options.

-m is the default option.

For testing a few disks or for sampling disks in larger arrays.

-f filename

Utility tests system/device combinations listed in a text file.

May be used with -r and -t options.

For testing several disks.

-g disk_group

Utility tests all disk devices in a specified disk group.

May be used with -r and -t options.

For testing many disks and arrays of disks. Disk groups may be temporarily created for testing purposes and destroyed (ungrouped) after testing.

Using the -r Option for Non-destructive Testing

To test disk devices containing data you want to preserve, you can use the -r option with the -m, -f, or -g options, which are described in the following sections. For example, to use the -m option and the -r option, you can run the utility by entering:


/opt/VRTSvcs/vxfen/bin/vxfentsthdw -rm

When invoked with the -r option, the utility does not use tests that write to the disks. Therefore, it does not test the disks for all of the usual conditions of use.

Using the -m Option

The -m option for vxfentsthdw is described in detail in chapter 3.

Using the -f Option

Use the -f option to test disks that are listed in a text file. For example, you can create a file to test two disks shared by systems galaxy and nebula that might resemble:


galaxy /dev/rdsk/c2t2d1s2 nebula /dev/rdsk/c3t2d1s2
galaxy /dev/rdsk/c2t2d2s2 nebula /dev/rdsk/c3t2d2s2

where the first disk is listed in the first line and is seen by galaxy as /dev/rdsk/c2t2d1s2 and by nebula as /dev/rdsk/c3t2d1s2. The other disk, in the second line, is seen as /dev/rdsk/c2t2d2s2 from galaxy and /dev/rdsk/c3t2d2s2 from nebula. Typically, the list of disks could be extensive.

Suppose you created the file named disks_blue. To test the disks, you would enter:


/opt/VRTSvcs/vxfen/bin/vxfentsthdw -f disks_blue

The utility reports the test results one disk at a time, just as for the -m option.

You can redirect the test results to a text file. Precede the command with "yes" to acknowledge that the testing destroys any data on the disks to be tested.


Caution  Caution    Be advised that by redirecting the command's output to a file, a warning that the testing destroys data on the disks cannot be seen until the testing is done.

For example:


# yes | /opt/VRTSvcs/vxfen/bin/vxfentsthdw -f disks_blue > blue_test.txt

Using the -g Option

Use the -g option to test all disks within a disk group. For example, you create a temporary disk group consisting of all disks in a disk array and test the group.


Note   Note    Do not import the test disk group as shared; that is, do not use the -s option.

The utility reports the test results one disk at a time. You can redirect the test results to a text file for review.


/opt/VRTSvcs/vxfen/bin/vxfentsthdw -g red_disks_dg > redtest.txt

After testing, destroy the disk group and put the disks into disk groups as you need.

Testing a Disk with Existing Keys

If the utility detects that a coordinator disk has existing keys, you see a message that resembles:


There are VERITAS I/O Fencing keys on the disk. Please make sure
that I/O Fencing is shut down on all nodes of the cluster before
continuing.
         ******** WARNING!!!!!!!! ********
THIS SCRIPT CAN ONLY BE USED IF THERE ARE NO OTHER ACTIVE NODES IN
THE CLUSTER!  VERIFY ALL OTHER NODES ARE POWERED OFF OR INCAPABLE
OF ACCESSING SHARED STORAGE.

If this is not the case, data corruption will result.
Do you still want to continue : [y/n] (default: n) y

The utility prompts you with a warning before proceeding. You may continue as long as I/O fencing is not yet configured.

 ^ Return to Top Previous  |  Next  >  
Product: Storage Foundation for Oracle RAC Guides  
Manual: Storage Foundation 4.1 for Oracle RAC Installation and Configuration  
VERITAS Software Corporation
www.veritas.com