IBM(R) Total Storage Multipath Subsystem Device Driver Version 1.6.0.1-11.2 README for Linux 2.6 March 06, 2006 ------------------------------------------------------------------------------- CONTENTS 1.0 About this README file 1.1 Who should read this README file 1.2 How to get help 2.0 Prerequisites for SDD 3.0 SDD Change History 3.1 Defects Fixed 3.1.1 Common 3.1.2 ESS/DS8000/DS6000 Defects 3.1.3 SVC Defects 3.1.4 SVCCISCO Defects 3.2 New Features 3.3 Feature Details 3.4 Known Issues 3.5 Correction to User's Guide 4.0 User License Agreement for IBM Device Drivers 5.0 Notices 6.0 Trademarks and Service Marks ------------------------------------------------------------------------------- 1.0 About this README file Welcome to IBM Totalstorage Multipath Subsystem Device Driver (SDD). This README file contains the most recent information about the IBM Totalstorage Multipath Subsystem Device Driver, Version 1.6.0.1-11.2 for Linux. IBM recommends that you go to the following Web site to get the most current information about this release of SDD: http://www.ibm.com/servers/storage/support/software/sdd/ You should carefully review the following information available through the website: 1. The most current README file. This will contain corrections to this readme file, corrections to the SDD User's Guide, and other documentation updates discovered since this copy of the README was prepared. 2. The Multipath SDD User's Guide. Because SDD can be installed in so many different environments / configurations, detailed information about each environment is placed in the appropriate chapter of the Multipath SDD Users Guide. The 'Summary of Changes' section of the SDD Users' Guide can help you quickly determine if the latest changes affect you. 3. The Flashes. As we become aware of any information that is likely to impact a broad set of our customers, Flashes are prepared and posted on this site. You should review this section periodocally to see any new Flashes that have been posted since your last review. For prerequisites information, be sure to look in the Multipath SDD User's Guide as well as the prerequisites section of this readme file for the latest updates. 1.1 Who should read this README file This README file is in general intended for storage administrators, system programmers, and performance and capacity analysts. The information in this file only applies to customers who run: 1. ESS, DS8000, DS6000, SAN Volume Controller, or SAN Volume Controller for Cisco MDS 9000 2. ESS and SAN Volume Controller 3. ESS and SAN Volume Controller for Cisco MDS 9000 Please refer to SDD support matrix to determine the supported SDD levels for above storage subsystem. 1.2 How to get help Go to the following Web site for SDD technical support and for the most current SDD documentation and support information: http://www.ibm.com/servers/storage/support/software/sdd/ Go to the following Web site for the IBM ESS Open Systems support: http://www.storage.ibm.com/hardsoft/products/ess/supserver.htm Go to the following Web site for IBM TotalStorage DS8000 support: http://www.ibm.com/servers/storage/disk/ds8000/index.html Go to the following Web site for IBM TotalStorage DS6000 support: http://www.ibm.com/servers/storage/disk/ds6000/index.html Go to the following Web site for IBM TotalStorage SAN Volume Controller support: http://www.ibm.com/servers/storage/support/virtual/2145.html Go to the following Web site for IBM TotalStorage SAN Volume Controller for Cisco MDS 9000 support: http://www.ibm.com/servers/storage/support/virtual/2062-2300.html Call one of the following numbers to obtain nontechnical or administrative support, such as hardware and software orders, hardware maintenance, services contract of entitlement, and invoices: .For commercial or state and local support operations: 1-877-426-6006 (Listen to the voice prompts) .For business partner support operations: 1-800-426-9990 .For federal government support operations: 1-800-333-6705 ------------------------------------------------------------------------------- 2.0 Prerequisites for SDD One of the following combinations of a Linux distribution and associated vendor compiled binary kernel packages: SuSE SLES 9 (x86, ppc64, x86_64) No support due to potential kernel issue that causes data corruption. Red Hat Enterprise Linux 4 (x86) with one of the following kernels: kernel-smp-2.6.9-5.EL kernel-hugemem-2.6.9-5.EL kernel-smp-2.6.9-5.0.3.EL kernel-hugemem-2.6.9-5.0.3.EL kernel-smp-2.6.9-5.0.5.EL kernel-hugemem-2.6.9-5.0.5.EL kernel-smp-2.6.9-11.EL kernel-hugemem-2.6.9-11.EL kernel-smp-2.6.9-22.EL * kernel-hugemem-2.6.9-22.EL * kernel-smp-2.6.9-22.0.1.EL * kernel-hugemem-2.6.9-22.0.1.EL * kernel-smp-2.6.9-22.0.2.EL * kernel-hugemem-2.6.9-22.0.2.EL * kernel-smp-2.6.9-34.EL * kernel-hugemem-2.6.9-34.EL * Red Hat Enterprise Linux 4 (ppc64) with one of the following kernels: kernel-2.6.9-11.EL kernel-2.6.9-22.EL * kernel-2.6.9-22.0.1.EL * kernel-2.6.9-22.0.2.EL * kernel-2.6.9-34.EL * Red Hat Enterprise Linux 4 (x86_64) with one of the following kernels: kernel-smp-2.6.9-11.EL kernel-smp-2.6.9-22.EL * kernel-smp-2.6.9-22.0.1.EL * kernel-smp-2.6.9-22.0.2.EL * kernel-smp-2.6.9-34.EL * * Newly supported in this release. ------------------------------------------------------------------------------- 3.0 SDD Change History =============================================================================== 3.1 Defects Fixed 3.1.1 Common 1.6.0.1-11.2 o 3523 Replace deprecated SCSI_IOCTL_SEND_COMMAND in userspace. o 3628 Fix 'datapath query wwpn' error with Emulex adapters. o 3645 SDD vpath devices no longer go into DEAD state and OFFLINE mode for direct I/O when all paths fail. o 3649 Fix 'sddgetdata' script to handle qlogic proc entry. o 3651 Add epoch time to SDD log timestamp. o 3653 Fix memory allocation problem on cfgvpath. 1.6.0.1-10 o 3366 SDDSRV stops logging when log file is removed. o 3484 Enable system error logging for SDDSRV. o 3489 Fix errors in adapter state and mode transitions during a fatal write error, i.e. an I/O to a LUN fails across all available paths triggering SDD to permanently disable the vpath by putting its paths into DEAD state and OFFLINE mode. 1.6.0.1-8 o 3473 Ensure that the command-line 'debug' options, i.e. 'cfgvpath debug' and 'rmvpath debug', have consistent descriptions and behavior, printing the debug messages to stdout. o 3475 Fix incomplete solution to 3461 (see below). Pass through Linux HDIO_GETGEO ioctl calls correctly down to the scsi disk device for vpath partitions instead of just to the whole device. o 3450 Fix problems in path state transition. 1.6.0.1-6 o 3407 Fix incomplete request queue handling fix from defect 3364. 1.6.0.1-5 o 3365 Fix cfgvpath to wait a maximum of a minute for vpath device nodes to appear before exiting and printing an error. o 3364 Fix to allow vpath to handle bigger I/O requests to match sd device behavior. o 3341 Fix problem where /etc/vpath.conf was not updated with debugging enabled, i.e. 'rmvpath debug'. o 3340 Fix 'datapath query wwpn' to handle more than ten adapter wwpns. 1.6.0.1-3 o 3156 Fix potential system hang during sdd.log trace collection. 1.6.0.1-2 o 3125 Fix incorrect creation and handling of exclusion list used by SDD during configuration. 3.1.2 ESS defects None 3.1.3 SVC defects None 3.1.4 SVCCISCO defects None =============================================================================== 3.2 New Features 1.6.0.1-11.2 o PCR 2889 Add SDD trace collection script for problem determination (sddgetdata). o OAR 1003 Add x86_64 support for Red Hat Enterprise Linux 4. o OAR 1012 Add x86_64 support for SuSE Linux Enterprise Server 9. 1.6.0.1-8 o sw 3474 Add support for SuSE Linux Enterprise Server 9 Service Pack 2 (Linux 2.6 kernel). o sw 3456 Add "makenodes" argument to the cfgvpath command to enable cfgvpath to create device nodes similar to what is done in Linux 2.4. 1.6.0.1-4 o PCR 2911 Add support for Red Hat Enterprise Linux 4 (Linux 2.6 kernel). 1.6.0.1-3 o PCR 2886 Add "-l" option to datapath query device command to indicate paths to a non-preferred controller. 1.6.0.1-2 o PCR 2447 Add support for SuSE Linux Enterprise Server 9 Service Pack 1 (Linux 2.6 kernel). =============================================================================== 3.3 Feature Details 1.6.0.1-11.2 o PCR 2889 Add SDD trace collection script (located at /opt/IBMsdd/bin/sddgetdata). Run the script "sddgetdata" to collect SDD trace data and host logs to support SDD problem determination and resolution. The resulting file (sdd_data_$date_time$.tar.gz) will be saved to the current working directory. o OAR 1003, 1012 Add x86_64 support for Red Hat Enterprise Linux 4 and SuSE Linux Enterprise Server 9. See list above for supported kernel levels. 1.6.0.1-8 o sw 3474 Add support for SuSE Linux Enterprise Server 9 Service Pack 2 (Linux 2.6 kernel). See above for supported kernel levels. o sw 3456 Add "makenodes" argument to the cfgvpath command to enable cfgvpath to create device nodes similar to what is done in Linux 2.4. Usually, the creation of the device nodes in Linux 2.6 is done automatically using a combination of the udev and hotplug systems. However, it is sometimes desirable to have cfgvpath manually create nodes for the user (one good example is during the remote boot process, when the udev and hotplug systems are not loaded yet). The device nodes reside in /dev/vpathXX and are one of the primary ways the user can access an SDD vpath device. 1.6.0.1-4 o PCR 2911 Add support for Red Hat Enterprise Linux (RHEL) 4 running the Linux 2.6 kernel. See above for supported kernel levels. 1.6.0.1-3 o PCR 2886 A new feature has been introduced to datapath to aid users to in verifying their SAN configurations in a controller environment (such as with the SAN Volume Controller). The datapath query device command now has a new option '-l' to display paths to non-preferred controllers. For example, if users have 4 paths per SDD vpath device and they would like to configure a equal distribution between preferred controller and non-preferred controller, they will configure their environment with 2 paths from a preferred controller and another 2 paths from a non-preferred one. This feature will help users to verify their configuration by indicating which path is from the non-preferred controller before the device starts operation. For 'datapath query device', a new option, '-l', is added to mark the non-preferred paths with an asterisk. This option can be used in addition to the existing datapath query device command. For example: - datapath query device -l - datapath query device -l In the datapath query device output, the non-preferred paths are marked with a *, as below: DEV#: 35 DEVICE NAME: vpathbd TYPE: 2145 POLICY: Optimized Sequential SERIAL: 60050768018b800a800000000000008c LUN IDENTIFIER: 60050768018b800a800000000000008c ============================================================================ Path# Adapter/Hard Disk State Mode Select Errors 0* Host3Channel0/sdcu CLOSE NORMAL 0 0 1 Host3Channel0/sddc CLOSE NORMAL 22985 0 2 Host2Channel0/sds CLOSE NORMAL 26398 0 3* Host2Channel0/sdk CLOSE NORMAL 0 0 1.6.0.1-2 o PCR 2447 Add support for SuSE Linux Enterprise Server (SLES) 9 Service Pack 1 running on the Linux 2.6 kernel. Note that the Linux 2.6 kernel is significantly different from the Linux 2.4 kernel supported on our previous releases. See above for supported kernel levels. =============================================================================== 3.4 Known Issues o Please refer to the SDD User's Guide for a complete list. =============================================================================== 3.5 Correction to User's Guide o Understanding error recovery policy during total path failure Due to potential data corruption issues, if a write I/O fails on all paths of an SDD vpath device, then all the paths are put into DEAD/OFFLINE state and can only be made available again through manual intervention. That is, you have to unmount the SDD vpath device and should run fsck to check and repair it if necessary. o Configuring SDD at system startup To enable run level X at startup: for Red Hat kernels, use 'chkconfig --level X sdd on' for SuSE kernels, use 'chkconfig --set sdd X' o Supported Filesystem Statement In the current User's Guide, we make various statements regarding specific filesystem support. For Linux 2.6 kernels (the SLES 9 and RHEL 4 distributions) SDD currently only supports the following filesystems: o ext2 o ext3 Please ensure that you do not run any other filesystems on your SDD vpath devices. o Change in the path state transition During path open or sddsrv path probing, SDD will no longer skip CLOSE OFFLINE paths. Their state will be changed to INVALID if open fails or DEAD if open succeeds and mode remains in OFFLINE. CLOSED_DEAD path will stay in CLOSED_DEAD during vpath open, instead of changing into INVALID state. ------------------------------------------------------------------------------ 4.0 User License Agreement for IBM Device Drivers See LICENSE file located in /opt/IBMsdd. ------------------------------------------------------------------------------- 5.0 Notices This information was developed for products and services offered in the U.S.A. IBM may not offer the products, services,or features discussed in this document in other countries. Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead. However, it is the user's responsibility to evaluate and verify the operation of any non-IBM product, program, or service. IBM may have patents or pending patent applications covering subject matter described in this document. The furnishing of this document does not give you any license to these patents. You can send license inquiries, in writing, to: IBM Director of Licensing IBM Corporation North Castle Drive Armonk, NY 10504-1785 U.S.A. For license inquiries regarding double-byte (DBCS) information, contact the IBM Intellectual Property Department in your country or send inquiries, in writing, to: IBM World Trade Asia Corporation Licensing 2-31 Roppongi 3-chome, Minato-ku Tokyo 106, Japan The following paragraph does not apply to the United Kingdom or any other country where such provisions are inconsistent with local law: INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND,EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you. Any references in this information to non-IBM Web sites are provided for convenience only and do not in any manner serve as an endorsement of those Web sites. The materials at those Web sites are not part of the materials for this IBM product and use of those Web sites is at your own risk. This information could include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. IBM may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time without notice. IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you. Licensees of this program who wish to have information about it for the purpose of enabling: (i) the exchange of information between independently created programs and other programs (including this one) and (ii) the mutual use of the information which has been exchanged, should contact: IBM Corporation Information Enabling Requests Dept. DZWA 5600 Cottle Road San Jose, CA 95193 U.S.A. Such information may be available, subject to appropriate terms and conditions, including in some cases, payment of a fee. The licensed program described in this document and all licensed material available for it are provided by IBM under terms of the IBM License Agreement for Non-Warranted Programs. Any performance data contained herein was determined in a controlled environment. Therefore, the results obtained in other operating environments may vary significantly. Some measurements may have been made on development-level systems and there is no guarantee that these measurements will be the same on generally available systems. Furthermore, some measurement may have been estimated through extrapolation. Actual results may vary. Users of this document should verify the applicable data for their specific environment. Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. This information contains examples of data and reports used in daily business operations. To illustrate them as completely as possible, the examples include the names of individuals, companies, brands, and products. All of these names are fictitious and any similarity to the names and addresses used by an actual business enterprise is entirely coincidental. =============================================================================== IBM agreement for licensed internal code +---- Read Before Using -----------------------------------------------+ |IMPORTANT | | | |YOU ACCEPT THE TERMS OF THIS IBM LICENSE AGREEMENT FOR MACHINE CODE BY| |YOUR USE OF THE HARDWARE PRODUCT OR MACHINE CODE. PLEASE READ THE | |AGREEMENT CONTAINED IN THIS BOOK BEFORE USING THE HARDWARE PRODUCT.SEE| |IBM agreement for licensed internal code. | | | +----------------------------------------------------------------------+ You accept the terms of this Agreement(3) by your initial use of a machine that contains IBM Licensed Internal Code (called "Code"). These terms apply to Code used by certain machines IBM or your reseller specifies (called "Specific Machines"). International Business Machines Corporation or one of its subsidiaries ("IBM") owns copyrights in Code or has the right to license Code. IBM or a third party owns all copies of Code, including all copies made from them. If you are the rightful possessor of a Specific Machine, IBM grants you a license to use the Code (or any replacement IBM provides) on, or in conjunction with, only the Specific Machine for which the Code is provided. IBM licenses the Code to only one rightful possessor at a time. Under each license, IBM authorizes you to do only the following: 1. execute the Code to enable the Specific Machine to function according to its Official Published Specifications (called "Specifications"); 2. make a backup or archival copy of the Code (unless IBM makes one available for your use), provided you reproduce the copyright notice and any other legend of ownership on the copy. You may use the copy only to replace the original, when necessary; and 3. execute and display the Code as necessary to maintain the Specific Machine. You agree to acquire any replacement for, or additional copy of, Code directly from IBM in accordance with IBM's standard policies and practices. You also agree to use that Code under these terms. You may transfer possession of the Code to another party only with the transfer of the Specific Machine. If you do so, you must 1) destroy all your copies of the Code that were not provided by IBM, 2) either give the other party all your IBM-provided copies of the Code or destroy them, and 3) notify the other party of these terms. IBM licenses the other party when it accepts these terms. These terms apply to all Code you acquire from any source. Your license terminates when you no longer rightfully possess the Specific Machine. Actions you must not take You agree to use the Code only as authorized above. You must not do, for example, any of the following: 1. Otherwise copy, display, transfer, adapt, modify, or distribute the Code (electronically or otherwise), except as IBM may authorize in the Specific Machine's Specifications or in writing to you; 2. Reverse assemble, reverse compile, or otherwise translate the Code unless expressly permitted by applicable law without the possibility of contractual waiver; 3. Sublicense or assign the license for the Code; or 4. Lease the Code or any copy of it. ------------------------------------------------------------------------------- 6.0 Trademarks and service marks The following terms are trademarks of the International Business Machines Corporation in the United States,other countries, or both: AIX AS/400 Enterprise Storage Server HACMP/6000 IBM IBM logo iSeries Netfinity NetVista Operating System/400 pSeries RS/6000 Seascape SP System/360 System/370 System/390 The eServer logo TotalStorage Versatile Storage Server xSeries zSeries z/Architecture z/OS Microsoft, Windows, Windows NT, and the Windows logo are registered trademarks of Microsoft Corporation. Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both. UNIX is a registered trademark of The Open Group in the United States and other countries. Other company, product, and service names may be trademarks or service marks of others. ------------------------------------------------------------------------------- (C) Copyright IBM Corporation 2000, 2002, 2003, 2004, 2005. All rights reserved.