IBM pSeries PCI-X Dual Channel Ultra320 SCSI Adapter README

IBM eServer

PCI-X Dual Channel Ultra320 SCSI Adapter
CCIN: 5702

 DATE: Feb 02, 2006

Table of Contents

1.0 Microcode Change History

2.0 General Information
2.1 Installation Time
2.2 Machine's Affected
2.3 AIX Requirements
2.4 Linux Requirements

3.0 Determine the Current Microcode Level for AIX
3.1 Determine the Current Microcode Level for Linux

4.0 Downloading and Unpacking the Firmware Update Package from CORE
4.1 Downloading the RPM Format File to the Target Server
4.2 Discovery Tool Microcode CD-ROM creation and download instructions

5.0 Verifying microcode before download and notes
5.1 Microcode Download Procedure-PCI-X Dual Channel Ultra320 SCSI Adapter for AIX
5.2 Microcode Download Procedure-PCI-X Dual Channel Ultra320 SCSI Adapter for Linux (SLES 9 SP1, RHEL4 and above)
5.3 Microcode Download Procedure-PCI-X Dual Channel Ultra320 SCSI Adapter bus for Linux (SLES 9 base, RHEL3 and prior)

=====================================================================================

1.0 Microcode Change History:

0508006a
-Fixes Selection Timeout Problems w/ HUS10K DASD.

-SCSI Target Mode fix for possible hung I/O operation
-Added support for vendor unique “c0” command used in Atape & 3590 configurations w/ HVD/LVD converter and created workaround to prevent SCSI bus hang resulting in reset condition
-Fix to prevent the following: Data may exist in the cache marked for the same section of disk. The older data was in the process of being destaged when power was lost on the adapter while the newer data was just written. The older data has a chance to be written back to disk upon power on rather than the newer. This problem was seen sporadically in test w/ the IBM Hitachi 15K Rpm DASD.

05080064
Do not install this level. Configuration Problems w/ HUS10K DASD.

-New revision level of microcode.

-Ported 20MBps SE fix to new revision level.

02080039 Added detection for invalid DMA's. This DMA issue represents a potential data error. IBM recommends that you install this fix immediately.

02080037
-Minimum support level for HV products
-Increased BATs speed (Adapter/Controller comes available faster on bringup)
-Added support for HV products

02080032
Prior to microcode update, a shutdown is performed to the I2C bus to acquiesce activity. This prevents the I2C bus from getting hung and the Virtual SES devices from coming up "defined".

0208002f
-Virtual SES code fix (SF2, L4).
1) (SF2, L4) I2C bus may hang when adapter reset occurs while the adapter is reading the EEPROM on the I2C bus. Reduce window of occurrence.
2) (L4). I2C bus timeout when adapter is reset and running diagnostics.

0208002d
-Virtual SES fixes: a) LED fix for L4 system and b) PCI-X Quad Channel Ultra320 SCSI RAID Adapter fix for all systems
-Error log changes: a) Differentiated a error condition. Adapter now logs a specific error instead of generic for a given situation. b) Return the correct error information to the pSeries Adapter Device Driver (ADD) so a SCSI adapter detected CRC error is logged instead of a program error microcode problem. Problem was seen on L4, SF2 and SF4.
-Added Linux support features and fixed Linux drive replacement problem
-Force SE mode to 20MBps when an SE device is connected to the 7029-6C3/6E3 new feature backplane. This backplane expands the Integrated SCSI Controller adding an external port.

02080029
Modification to run Ultra320 speeds using Linux kernel 2.6.
Various performance enhancements.

02080026
External SE device fix; external SE devices are limited to 20MBps. SRN's 6C9-103 and/or 2522-720 may be displayed when Diagnostic's is run against this adapter prior to installing microcode.
Added support for unique vendor command on 3580/3583 LTO tape device.

02080025
Resolves SCSI_ERR10 (SCSI Bus Reset) condition upon Diagnostic's System Verification or Microcode Download in 7028-6C1 w/ safte device.

02080024
Enhanced SCSI signal path validation.
Removed extended Target Mode delays.
Removed erroneous AIX errors logged during drive microcode download.
Added unique RAID array identifiers for Linux support.
Removed erroneous SCSI bus reset error logged when a device reports an error condition.
Corrected extended SCSI bus reset that may occur when running HACMP.

0208001c
Installing two 4-pack backplanes in a p615 may cause the second backplane (sesX) to boot in the defined state or not be seen. Microcode 001c corrects this problem.

02080014
GA level

Note: In order for Ultra320 to function properly a minimum level of microcode is required for the DASD. These are listed below

Drive Type	Microcode Level (Hex)	Microcode level (ASCII as appears in VPD)
Cheetah73LP (9GB)	C54E	43353445
Cheetah73LP (18GB+)	C50E	43353045
Cheetah146LP	C50F	43353046
Cheetah73LP-X15	C51A	43353141
Ultrastar73	S5DE	53354445
US146Z10	S28C	53323843

2.0 General information

SUBJECT: PCI-X Dual Channel Ultra320 SCSI Adapter

******* PLEASE READ THIS ENTIRE NOTICE *********

2.1 Installation Time:
Approximately 30 minutes

2.2 Machine's Affected:
7028-6C1/6E1,6C4/6E4
7029-6C3/6E3
7038-6M2
7039-651
7040-671/681/61D/61R
7311-D10/D20

9110-510
9111-285/520
9112-265
9113-550

9114-275

9115-505
9117-570

9118-575

9119-590/595

9123-710
9124-720

9131-52A

9133-55A
9406-520/550/750

2.3 AIX Requirements:

For support: AIX 5.1 ML_04 or AIX 5.2 ML_01
For U320 support: AIX 5.1 ML_05, AIX 5.2 ML_02, AIX 5.3 or above along w/ the aforementioned minimum DASD microcode requirement

2.4 Linux Requirements:
For support: SLES 8 SP3 or RHEL 3 U1 or above

Notes:
-SLES9 SP1 and RHEL4 introduce the functionality of the "iprconfig" utility which is referenced in the instructions for Linux sections, below.
-If you are using SLES9 base level, RHEL3 or below then please follow the instructions for AIX through section 5.0. To flash the microcode continue to section 5.3.
-"iprconfig", the tool referenced in the Linux instructions, may be available in a Linux RPM package. The tool set is called "iprutils".

3.0 Determine the Current Microcode Level for AIX:

Before you install the microcode, it is important to determine the microcode level of the Adapter installed in the target system. Use

the following instructions to read the ROM level stored in the Adapter's VPD.

1) List the SCSI adapters installed in the system by typing:

lsdev -C | grep sisscsia

Note: All of the SCSI initiators addresses that are installed will be displayed. The SCSI initiators names will be sisscsiaX, where X is 0, 1, etc.

2) To check the current microcode level for the adapter or controller enter the following command

lscfg -vl sisscsiaX

Where X is the number/s of the previous command. The Command will produce output similar to

DEVICE LOCATION DESCRIPTION

sisscsia1        U0.1-P1-I4 PCI-X Dual Channel Ultra320 SCSI Adapter

      PCI-X Dual Channel Ultra320 SCSI Adapter:
        Part Number.................97P3359
        FRU Number..................97P3359
        Serial Number...............YL1093176118
        Manufacture ID..............0009
        EC Level....................0
        ROM Level.(alterable).......0208000f
        Product Specific.(Z0).......5702
        Device Specific.(YL)........U0.1-P1-I4

If the ROM Level is less than X5XX006a then you should update the microcode.

3.1 Determine the Current Microcode Level for Linux:

RHEL 3:
1) To list the scsi initiators Type: "ls /proc/scsi/ipr"

The Command will produce output similar to
"0 1 2"
2) To check the current microcode level for the adapter or controller Type: "cat /proc/scsi/ipr/X" (where X is the number from the previous command).
The Command will produce output similar to
"Firmware Version: 0208000f"

SLES 8 SP4:
1) To list the scsi initiators Type: "ls /proc/scsi/ibmsis"
The Command will produce output similar to
"0 1 2"
2) To check the current microcode level for the adapter or controller Type: "cat /proc/scsi/ibmsis/X" (where X is the number from the previous command)
The Command will produce output similar to
"Firmware Version: 0208000f"

SLES 9 and RHEL 4:
1) Type "iprconfig"
2) Select "Display hardware status"
3) Select SCSI adapter by typing a "1" in front of it and pressing Enter.
4) The Command will produce output similar to
"Firmware Version . . . . . . . . . . . . : 02080032"

4.0 Downloading and Unpacking the Firmware Update Package from CORE

NOTE: The CORE image will now be the RPM Format File.

1) After downloading the files from CORE on to your personal system find the following files in the CORE destination directory (c:\ibmdocs\DISKIMG):
A) "pci.1069B166.08-0508006a-1.aix5.1.noarch.rpm"
B) "pci.1069B166.08-0508006a-1.Linux.noarch.rpm"
2) Log in to the Target Server
3) Create a directory, if not already existent (mkdir /tmp/microcode; mkdir /tmp/microcode/RPM)
4) Transfer the file to the Target Server "/tmp/microcode/RPM directory" using ftp or another method. Change to that directory, "cd /tmp/microcode/RPM".
5a) For AIX, SLES9 base, RHEL3 & prior: Unpack the RPM file by using the following command: "rpm -ihv --ignoreos pci.1069B166.08-0508006a-1.aix5.1.noarch.rpm"
5b) For SLES9 SP1, RHEL4 & above: Unpack the RPM file by using the following command: "rpm -ihv --ignoreos pci.1069B166.08-0508006a-1.Linux.noarch.rpm"
6a) For AIX, SLES9 base, RHEL3 & prior: The microcode files will be added to /usr/lib/microcode/.
6b) For SLES9 SP1, RHEL4 & above: The microcode files will be added to /lib/firmware/.

4.1 Downloading the RPM Format File to the Target Server
Use this method to download to an AIX or Linux system:

Note: The instructions that follow are specific AIX/Linux commands. AIX/Linux commands are CASE (lower and upper) SENSITIVE, and must be entered exactly as shown, including filenames.

1) Make a directory on an AIX/Linux system to receive the RPM format file.
Enter: "mkdir /tmp/microcode"

Enter: "mkdir /tmp/microcode/RPM"

2) Transfer the RPM format file to the /tmp/microcode/RPM directory (using "Save as ..."). Change to that directory, "cd /tmp/microcode/RPM".

You'll see the filenames for the RPM files.
    A) For AIX, SLES9 base, RHEL3 & prior, the filename is pci.1069B166.08-0508006a-1.aix5.1.noarch.rpm
    B) For SLES9 SP1, RHEL4 & above, the filename is pci.1069B166.08-0508006a-1.Linux.noarch.rpm
3) Unpack the file by executing the instructions below:
    A) For AIX, SLES9 base, RHEL3 & prior, type "rpm -ihv --ignoreos pci.1069B166.08-0508006a-1.aix5.1.noarch.rpm"
    B) For SLES9 SP1, RHEL4 & above, type "rpm -ihv --ignoreos pci.1069B166.08-0508006a-1.Linux.noarch.rpm"
4a) For AIX, SLES9 base, RHEL3 & prior: The microcode files will be added to /usr/lib/microcode/.
4b) For SLES9 SP1, RHEL4 & above: The microcode files will be added to /lib/firmware/.

4.2 Discovery Tool Microcode CD-ROM creation and download instructions

To obtain information how to burn a CD-ROM and run the Discovery Tool for an AIX System please go to: CDROMhelp.html
1) After running the Discovery Tool successfully the "/tmp/microcode/RPM" directory was created and your rpm files are copied from the CD-ROM.

2) Change to that directory, "cd /tmp/microcode/RPM".

3) Unpack the file by executing the instructions below:
Enter the commands:
rpm -ihv --ignoreos pci.1069B166.08-0508006a-1.aix5.1.noarch.rpm
4) Microcode files will be copied to "/etc/microcode". The file size and checksum of the microcode image will be verified in Section 5.0

Notes:
- "/etc/microcode" is a symbolic link to "/usr/lib/microcode".
- If permission does not allow the copy to the above stated directory
or file then the user will be prompted for a new location.

5.0 Verifying microcode before download and notes

NOTE: Microcode download must be performed separately for each Adapter bus under distinct Logical Partitions (LPAR's).
Please save current and older versions of the microcode update files in case you need to restore your system.

NOTE: Microcode Download CAN be performed concurrently.

Installation Time: Approximately 30 min System Time.

Please verify the file size and checksum of the raw microcode files matches the below.
Filesize: 881764
Checksum: 61749
For AIX, SLES9 base, RHEL3 & prior: "ls -l /usr/lib/microcode/44415254.0508006a" to verify Filesize.
"sum /usr/lib/microcode/44415254.0508006a" to verify Checksum.
For SLES9 SP1, RHEL4 & above: "ls -l /lib/firmware/pci.1069B166.08.0508006a" to verify Filesize.
"sum /lib/firmware/44415254.0508006a" to verify Checksum.

For systems that have LPAR installed, the microcode file must be placed on all partitions that have a SCSI device in order to update the code. Follow this procedure for each partition:

For AIX, SLES9 base, RHEL3 & prior:
    A) Log into the target partition.
    B) Type: "cd /usr/lib/microcode"
    C) FTP (for AIX) or SFTP (for Linux) to the partition that has the media bay assigned. (ie. ftp/sftp partition1.ibm.com)
    D) Type: "cd /usr/lib/microcode"
    E) If using FTP then Type: "bin"
    F) Type: "get 44415254.0508006a"
    G) Type: "quit"

For SLES9 SP1, RHEL4 & above:
    A) Log into the target partition.
    B) Type: "cd /lib/firmware"
    C) SFTP to the partition that has the media bay assigned. (ie. "sftp partition1.ibm.com")
    D) Type: "cd /lib/firmware"
    E) Type: "bin"
    F) Type: "get pci.1069B166.08.0508006a"
    G) Type: "quit"

5.1 Microcode Download Procedure-PCI-X Dual Channel Ultra320 SCSI Adapter for AIX

Procedure:
1) It is advised, but not necessary to stop all applications.
2) Enter diag
3) Select the "Task Selection" from diagnostics menu.
4) Select "Download Microcode" or "Microcode Tasks -> Download Microcode" from "Task Selection" menu.
5) Select all of the PCI-X Dual Channel Ultra320 SCSI Adapters that need to be updated from the list of devices by pressing "Enter". The devices will be displayed as sisscsia#, where # is the number of the device. Press "F7".
6) A dialogue box will be displayed on screen. Press "Enter" to continue.
7) Select "/usr/lib/microcode".
8) A dialogue box will may be displayed on screen. It will state that the current microcode level on the adapter is not in the /usr/lib/microcode directory. This is acceptable as you will be flashing new microcode onto the adapter. Also, incorrect code will automatically be rejected. Press "Enter" to continue.
9) An "M" will be displayed next to the latest level of microcode in the /usr/lib/microcode directory. Select that level and press "Enter".
10) The following message will appear on the screen when download is completed: "Microcode download complete successfully. The current microcode level for the device sisscsia# is ..... Please run diagnostics on the adapter to ensure that it is functioning properly." DO NOT run diagnostics on the device at this time.
11) Exit diagnostics.
12) Verify the code level is 0508006a by typing "lscfg -vl sisscsia#" for each scsi device updated. <Where # is the number sisscsia device>

5.2 Microcode Download Procedure-PCI-X Dual Channel Ultra320 SCSI Adapter for Linux (SLES9 SP1, RHEL4 & above)

Procedure:
1) Stop all applications.
2) Type "iprconfig" and press "Enter".
3) Select "Download Microcode" and press "Enter".
4) Select all of the PCI-X Dual Channel Ultra320 SCSI Adapters that need to be updated from the list of devices by pressing "1". Then press "Enter".
5) Select the appropriate microcode image to flash by pressing "1". (The image will end in 0039). Press Enter. Press Enter again to confirm.
6) If multiple devices were selected in step 4, then repeat step 5 until finished.

5.3 Microcode Download Procedure-PCI-X Dual Channel Ultra320 SCSI Adapter bus for Linux (SLES9 base, RHEL3 and prior)

Procedure:
1) Stop all applications.
2) From the Command Prompt: Type "iprupdate" and press "Enter".

0508006a	-Fixes Selection Timeout Problems w/ HUS10K DASD. -SCSI Target Mode fix for possible hung I/O operation -Added support for vendor unique “c0” command used in Atape & 3590 configurations w/ HVD/LVD converter and created workaround to prevent SCSI bus hang resulting in reset condition -Fix to prevent the following: Data may exist in the cache marked for the same section of disk. The older data was in the process of being destaged when power was lost on the adapter while the newer data was just written. The older data has a chance to be written back to disk upon power on rather than the newer. This problem was seen sporadically in test w/ the IBM Hitachi 15K Rpm DASD.
05080064	Do not install this level. Configuration Problems w/ HUS10K DASD. -New revision level of microcode. -Ported 20MBps SE fix to new revision level.
02080039	Added detection for invalid DMA's. This DMA issue represents a potential data error. IBM recommends that you install this fix immediately.
02080037	-Minimum support level for HV products -Increased BATs speed (Adapter/Controller comes available faster on bringup) -Added support for HV products
02080032	Prior to microcode update, a shutdown is performed to the I2C bus to acquiesce activity. This prevents the I2C bus from getting hung and the Virtual SES devices from coming up "defined".
0208002f	-Virtual SES code fix (SF2, L4). 1) (SF2, L4) I2C bus may hang when adapter reset occurs while the adapter is reading the EEPROM on the I2C bus. Reduce window of occurrence. 2) (L4). I2C bus timeout when adapter is reset and running diagnostics.
0208002d	-Virtual SES fixes: a) LED fix for L4 system and b) PCI-X Quad Channel Ultra320 SCSI RAID Adapter fix for all systems -Error log changes: a) Differentiated a error condition. Adapter now logs a specific error instead of generic for a given situation. b) Return the correct error information to the pSeries Adapter Device Driver (ADD) so a SCSI adapter detected CRC error is logged instead of a program error microcode problem. Problem was seen on L4, SF2 and SF4. -Added Linux support features and fixed Linux drive replacement problem -Force SE mode to 20MBps when an SE device is connected to the 7029-6C3/6E3 new feature backplane. This backplane expands the Integrated SCSI Controller adding an external port.
02080029	Modification to run Ultra320 speeds using Linux kernel 2.6. Various performance enhancements.
02080026	External SE device fix; external SE devices are limited to 20MBps. SRN's 6C9-103 and/or 2522-720 may be displayed when Diagnostic's is run against this adapter prior to installing microcode. Added support for unique vendor command on 3580/3583 LTO tape device.
02080025	Resolves SCSI_ERR10 (SCSI Bus Reset) condition upon Diagnostic's System Verification or Microcode Download in 7028-6C1 w/ safte device.
02080024	Enhanced SCSI signal path validation. Removed extended Target Mode delays. Removed erroneous AIX errors logged during drive microcode download. Added unique RAID array identifiers for Linux support. Removed erroneous SCSI bus reset error logged when a device reports an error condition. Corrected extended SCSI bus reset that may occur when running HACMP.
0208001c	Installing two 4-pack backplanes in a p615 may cause the second backplane (sesX) to boot in the defined state or not be seen. Microcode 001c corrects this problem.
02080014	GA level