Installation and Migration Guide

Tables

About this book

Who should use this book

How this book is organized

Typographic conventions

Interface instructions

Chapter 1. Overview of the installation and migration processes

What's new in PSSP and AIX?

Using Perspectives

Installing your SP system

Terminology

Prepare and install the control workstation

Enter node and configuration information

Install PSSP on the nodes (externals)

Install PSSP on the nodes (internals)

Migrating your SP system

Working with the basic AIX image

Building a new AIX image

Changing the node's install image attributes

Detailed overview of the network installation of a node

NIM-specific terminology and concepts

Network installation

Customization for network install

Boot processing

Configuring boot/install servers as NIM masters

Chapter 2. Installing and configuring a new RS/6000 SP system

Finding related installation information

Task A. Prepare the control workstation

Step 1: Verify the control workstation requirements

Step 2: Verify the network requirements

Step 3: Connect frames to your control workstation

Step 4: Configure RS-232 control lines

Step 5: Tune all control workstation network adapters

Step 6: Configure the control workstation Ethernet adapters

Step 7: Verify the control workstation interfaces

Step 8: Ensure that the necessary daemons are running on the control workstation

Step 9: Change the control workstation maximum default processes

Step 10: Change the control workstation tunables and tunable values

Step 11: Define space for the /spdata directory

Step 12: Create the required /spdata directories

Step 13: Define space for the NIM boot images

Step 14: Copy the AIX LP images and other required AIX LPs and PTFs

|Step 15: Copy the Correct level of PAIDE

Task B. Install PSSP on the control workstation

Step 16: Copy the PSSP images

Step 17: Copy a basic AIX (mksysb) image

|Step 18: Install PSSP prerequisites

Step 19: Install PSSP on the control workstation

File sets installed on the control workstation

File sets installed on the control workstation in later steps

Installation without AIX preinstalled

PSSP installation instructions

Step 20: Set authentication methods for AIX remote commands on the control workstation

Step 21: Initialize RS/6000 SP Kerberos V4 (optional)

Step 22: Configure DCE for the control workstation (required for DCE)

Step 23: Set the authentication method for SP Trusted Services on the control workstation

Step 24: Obtain credentials

Step 25: Complete system support installation on the control workstation

Step 26: Complete IBM Virtual Shared Disk installation (optional)

|Step 27: Apply PSSP PTFs (optional)

Step 28: Add the PSSP T/EC adapter (optional)

Step 29: Run SDR and System Monitor verification tests

Task C. Enter site environment, frame, node, switch, and security information

Step 30: Enter site environment information

|Step 31: Enter Hardware Management Console (HMC) information (optional)

|Step 32: Enter SP or multiple NSB frame information and reinitialize the SDR

|Step 33: Enter non-SP frame information and reinitialize the SDR (optional)

Step 34: Update the state of the supervisor microcode

Step 35: Verify System Monitor installation

Step 36: Verify frame information

Step 37: Enter the required node information

Step 38: Acquire the hardware Ethernet addresses

Step 39: Verify that the Ethernet addresses were acquired

Step 40: Configure additional adapters for nodes

|Step 41: Configure the aggregate IP interface for nodes (SP Switch2 only)

|Step 42: Configure the number of switch planes (SP Switch2 only)

Step 43: Configure initial host names for nodes

RS/6000 SP security installation and configuration

Step 44: Select security capabilities required on nodes

Step 45: Create DCE hostnames (required for DCE)

Step 46: Update the SDR with DCE master security and CDS server hostnames (required for DCE)

Step 47: Configure admin portion of DCE clients (required for DCE)

Step 48: Configure SP Trusted Services to use DCE authentication (required for DCE)

Step 49: Create SP Trusted Services DCE keyfiles (required for DCE)

Step 50: Select authorization methods for AIX remote commands

Step 51: Enable authentication methods for AIX remote commands

Step 52: Enable authentication methods for SP Trusted Services

Step 53: Start the key management daemon (required for DCE)

Step 54: Add an extension node (optional)

|Step 55: Start RSCT subsystems

|Step 56: Verify that RSCT subsystems have started

Step 57: Set up nodes to be installed

Step 58: Verify all node information

Step 59: Verify extension node information

Task D. Customize the nodes

Step 60: Change the default network tunable values

Step 61: Perform additional node customization

Step 62: Set up the switch

Step 63: Verify the switch primary and primary backup nodes

Step 64: Set the switch clock source for all switches (SP Switch only)

Step 65: Set up system partitions (SP Switch or switchless systems only)

Step 66: Configure the control workstation as the boot/install server

Step 67: Verify that the System Management tools were correctly installed

Task E. Power on and install the nodes

Step 68: Network boot optional boot/install servers

Step 69: Verify that System Management tools were correctly installed on the boot/install servers

Step 70: Network boot the remaining RS/6000 SP nodes

Step 71: Verify node installation

Step 72: Verify node expansion configuration information (optional)

|Step 73: Enable s1_tty on the SP-attached server (SAMI hardware protocol only)

|Step 74: Update authorization files in restricted mode for boot/install servers (optional)

Step 75: Run verification tests on all nodes

Step 76: Start the optional switch

Step 77: Verify that the switch was installed correctly

Step 78: Create DCE principals for the switch adapter host name (optional)

Step 79: Tune the network adapters

|Step 80: Authorize the SP administrative principals for remote command access

|Step 81: Apply PSSP PTFs to nodes (optional)

Run post-installation procedures

Chapter 3. Installing and configuring the High Availability Control Workstation

Finding related information

Task A: Prepare the control workstations

Step 1: Understand the procedure

Step 2: Plan network configuration

Step 3: Install the SP system

Step 4: Install AIX on the backup control workstation

Step 5: Back up the control workstations

Step 6: Set up the hardware

Step 7: Configure RS-232 control lines

Step 8: Set authentication methods for AIX remote commands on the backup control workstation

Step 9: Install PSSP on the backup control workstation

Task B. Update Kerberos V4 SP authentication services on the primary control workstation

Step 10: Add the Kerberos V4 principal

Step 11: Add the Kerberos V4 rcmd service key

Task C. Update Kerberos V4 SP authentication services on the backup control workstation

Step 12: Configure the backup control workstation as a secondary Kerberos V4 authentication server or client

Step 13: Copy Kerberos V4 keys to the backup control workstation

Step 14: Verify Kerberos V4 data

Task D. Install software

Step 15: Install HACMP or HACMP/ES on both control workstations

Step 16: Verify cluster software

Step 17: Install the HACWS image on both control workstations

Step 18: Stop the primary control workstation

Step 19: Configure serial network

Step 20: Configure the network

Step 21: Migrate the internal file system

Step 22: Set up the external file system

Step 23: Complete administration tasks

Task E. Configure High Availability Cluster Multi-Processing

Step 24: Define the cluster environment

Step 25: Configure the HACWS application server

Step 26: Define the resource group

Step 27: Verify the cluster and node environment

Task F. Set up and test the HACWS

Step 28: Make each control workstation addressable by its host name

Step 29: Set up the HACWS configuration

Step 30: Customize cluster event processing

Step 31: Add IP address aliases

Step 32: Verify the HACWS configuration

Step 33: Verify the hardware connections

Step 34: Reboot control workstations

Step 35: Start cluster services on the primary control workstation

Step 36: Verify the HACWS installation

|Chapter 4. Migrating the software on your RS/6000 SP system

High-level migration steps

Preparing to migrate

Applying PTFs to nodes

Migrating the control workstation

Partitioning your system (if necessary)

|Migrating a test node to PSSP 3.4

|Migrating the boot/install servers to PSSP 3.4

|Migrating the nodes to PSSP 3.4

Performing post-migration activity

Preparing to migrate

Step 1: Verify control workstation requirements

Step 2: Verify boot/install server requirements

Step 3: Understand system reconfiguration issues

Step 4 Understand workload management issues

Step 5: Understand system security issues

|Step 6: Understand LoadLeveler Issues

Step 7: Reserve port numbers

|Step 8: Understand runtime prerequisite issues

|Step 9: Archive and verify the SDR

Step 10: Back up your control workstation

Step 11: Back up your nodes

|Migrating the control workstation to PSSP 3.4

Step 1: Prepare to migrate and verify requirements

|Step 2: Quiesce your system

|Step 3: Migrate to AIX 4.3.3

Step 3a: Upgrade

Step 3b: Perform control workstation BOS migration install

Step 4: Verify AIX levels

Step 4a: Reboot the control workstation

Step 5: Verify the authentication value for AIX remote commands

Step 6: Verify the control workstation configuration

Step 7: Review space requirements for NIM boot images

Step 8: Import nonroot volume groups

Step 9: Review space requirements for /spdata

Step 10: Create the required /spdata directories

|Step 11: Copy the AIX 4.3.3 LP images and other required AIX LPs and PTFs

Step 12: Install correct level of PAIDE on the control workstation

|Step 13: Copy the PSSP images for PSSP 3.4

|Step 14: Install the runtime prerequisites

Step 15: Install (copy) the basic AIX (mksysb) image

Step 16: Stop daemons on the control workstation and verify

|Step 17: Obtain credentials

Step 18: Install PSSP on the control workstation

Step 19: Set authentication methods for SP Trusted Services

Step 20: Complete PSSP installation on the control workstation

Step 21: Verify the authentication values in the SDR

Step 22: Run SDR and System Monitor verification test

Step 23: Configure PSSP services and set up the site environment

Step 24: Update the state of the supervisor microcode

|Step 25: Start RSCT subsystems and verify

|Step 26: Refresh the pmand daemons (PSSP 2.4 only)

Step 27: Start the switch and any quiesced applications

Step 28: Run verification tests

Step 29: Update node description information

Step 30: Validate the network adapters

Step 31: Validate the control workstation

|Migrating the control workstation from AIX 4.3.3 to AIX 5L 5.1

|Step 1: Prepare to migrate and verify requirements

|Step 2: Quiesce your system

|Step 3: Perform control workstation BOS migration install to AIX 5L 5.1

|Step 4: Install the runtime prerequisites

|Step 5: Verify AIX levels

|Step 6: Review space requirements for NIM boot images

|Step 7: Review space requirements for /spdata

|Step 8: Create the required /spdata directories

|Step 9: Copy the AIX LP images and other required AIX LPs and PTFs

|Step 10: Verify the correct level of PAIDE

|Step 11: Obtain additional PSSP prerequisites

|Step 12: Install (copy) the basic AIX (mksysb) image

|Paths to migrate the nodes to PSSP 3.4

Before you migrate

BOS node upgrade

Step 1: Apply AIX 4.3.3 upgrade on the node

Step 2: Verify AIX migration

Step 3: Reboot the node

Step 4: Enter node configuration data

Step 5: Verify installation settings

|Step 6: Refresh RSCT subsystems

Step 7: Run setup_server to configure the changes

Step 8: Disable nodes from the switch

|Step 9: Copy the PSSP 3.4 pssp_script to nodes' /tmp

Step 10: Execute the pssp_script on the node

Step 11: Reboot the node

Step 12: Rejoin the nodes to the switch network

|Step 13: Start RSCT subsystems

Step 14: Run verification tests

|Step 15: Apply PSSP PTFs to nodes (optional)

BOS node migration install

Step 1: Enter node configuration data

Step 2: Verify installation settings

Step 3: Run setup_server to configure the changes

|Step 4: Refresh RSCT subsystems

Step 5: Disable nodes from the switch

Step 6: Shut down the node

Step 7: Network boot the node

Step 8: Rejoin the nodes to the switch network

Step 9: Run verification tests

|Step 10: Apply PSSP PTFs to nodes (optional)

mksysb install of nodes

Step 1: Enter node configuration data

Step 2: Verify installation settings

Step 3: Run setup_server to configure the changes

|Step 4: Refresh RSCT subsystems

Step 5: Disable nodes from the switch

Step 6: Shut down the node

|Step 7: Unconfigure DCE-related information for the node (required for DCE)

Step 8: Network boot the node

Step 9: Rejoin the nodes to the switch network

Step 10: Run verification tests

HACWS migration strategy

High-level HACWS migration instructions

Backing up your HACWS configuration

AIX migration considerations

HACMP migration considerations

PSSP migration steps

|Migrating an HACWS configuration to PSSP 3.4

Prerequisites

Step 1: Verify the authentication value for AIX remote commands

Step 2: Verify network tunable values

Step 3: Review space requirements for NIM boot images

Step 4: Review space requirements for /spdata

Step 5: Create the required /spdata directories

Step 6: Copy the AIX LP images and other required AIX LPs and PTFs

Step 7: Install the correct level of PAIDE on both control workstations

|Step 8: Copy the PSSP images for PSSP 3.4

|Step 9: Install the runtime prerequisites

Step 10: Install (copy) the basic AIX (mksysb) image

Step 11: Start control workstation services on the primary control workstation

Step 12: Stop control workstation services while HACMP is running

Step 13: Install PSSP on both control workstations

|Step 14: Authenticate as the Kerberos V4 administrative principal

Step 15: Set authentication methods for SP Trusted Services

Step 16: Complete PSSP installation on both control workstations

Step 17: Verify the authentication values in the SDR

Step 18: Verify the HACWS configuration

Step 19: Run SDR and System Monitor verification test

Step 20: Configure PSSP services and set up the site environment

Step 21: Update the state of the supervisor microcode

Step 22: Restart control workstation services

Step 23: Recycle the Event Manager daemons

|Step 24: Refresh the pmand daemons (PSSP 2.4 only)

Step 25: Run verification tests

|Step 26: Validate the network adapters

Step 27: Validate the control workstations

|Migrating an HACWS configuration to AIX 5L 5.1

|Prerequisites

|Step 1: Perform control workstation BOS migration install to AIX 5L 5.1

|Step 2: Install the runtime prerequisites

|Step 3: Verify AIX levels

|Step 4: Verify the correct level of PAIDE

|Step 5: Review space requirements for NIM boot images

|Step 6: Review space requirements for /spdata

|Step 7: Create the required /spdata directories

|Step 8: Copy the AIX LP images and other required AIX LPs and PTFs

|Step 9: Obtain additional PSSP prerequisites

|Step 10: Install (copy) the basic AIX (mksysb) image

|Step 11: Validate the control workstations

Post-migration activity

Remove obsolete files and resources

Recovery procedures

|Chapter 5. Reconfiguring security

Adding DCE to the SP system

Adding Kerberos V4 to the SP system

Installing and configuring Kerberos V4

Configure Kerberos V4 security for each system partition

|Enabling restricted root access (RRA)

|Using multiple boot/install servers with RRA

|Enabling a secure remote command method

|Configuring none for AIX remote command authorization

|Procedure for changing an SP system set up with dce:compat to dce only

Chapter 6. Reconfiguring the RS/6000 SP system

Adding a frame, SP-attached server, or clustered enterprise server

Step 1: Archive the SDR

Step 2: Unpartition your system

Step 3: Connect frames to your control workstation

Step 4: Configure RS-232 control lines

Step 5: Configure the Ethernet adapter (optional)

|Step 6: Enter Hardware Management Console (HMC) information (optional)

|Step 7: Enter SP or multiple NSB frame information and reinitialize the SDR

|Step 8: Enter non-SP frame information and reinitialize the SDR (optional)

Step 9: Verify frame information

Step 10: Add nodes

Adding nodes

Step 1: Archive the SDR

Step 2: Connect new nodes to the frame

Step 3: Update the state of the supervisor microcode

Step 4: Enter the required node information

Step 5: Acquire the hardware Ethernet addresses

Step 6: Verify that the Ethernet addresses were acquired

Step 7: Configure additional adapters for nodes

Step 8: Configure initial host names for nodes

Step 9: Set up nodes to be installed

Step 10: Update the security information for the new nodes

|Step 11: Refresh RSCT subsystems

Step 12: Verify all node information

|Step 13: Add the new node to the root authorization files

Step 14: Configure the boot/install server

Step 15: Change the default network tunable values

Step 16: Perform additional node customization

Step 17: Additional switch configuration

Step 18: Redefine system partitions (SP Switch or switchless systems only)

Step 19: Network boot optional boot/install servers

Step 20: Verify that System Management tools were correctly installed on the boot/install servers

Step 21: Network boot the remaining RS/6000 SP nodes

Step 22: Verify node installation

Step 23: Verify the SP expansion I/O unit configuration

|Step 24: Enable s1_tty on the SP-attached server or clustered enterprise server (SAMI hardware protocol only)

Step 25: Start the switch (optional)

Step 26: Verify that the switch was installed correctly

Step 27: Tune the network adapters for added nodes

Step 28: Reconfigure LoadLeveler to add the new node to the LoadLeveler cluster

|Adding an adapter to a node

|Step 1: Archive the SDR

|Step 2: Disable nodes from the switch

|Step 3: Shutdown the node

|Step 4: Install the new adapter

|Step 5: Define the adapter to the SDR

|Step 6: Update DCE information for a node (required for DCE)

|Step 7: Set node to customize

|Step 8: Verify installation settings

|Step 9: Refresh RSCT subsystems

|Step 10: Run setup_server to configure the changes

|Step 11: Reboot the node

|Step 12: Complete the DCE configuration of the new adapter (required for DCE)

|Step 13: Rejoin the nodes to the switch network

|Step 14: Validate new adapter

Deleting a frame, node, SP-attached server, or clustered enterprise server

Step 1: Archive the SDR

Step 2: Unpartition your system (SP Switch only)

Step 3: Reconfigure LoadLeveler to remove the frame data from the LoadLeveler cluster

|Step 4: Reconfigure IBM Virtual Shared Disk to remove the frame data from the IBM Virtual Shared Disk cluster

Step 5: Shut down SP-attached servers, clustered enterprise servers, or the nodes in the frame

Step 6: Disconnect the node from the frame (optional)

Step 7: Unconfigure DCE-related information for the node (required for DCE)

Step 8: Disconnect SP expansion I/O units from the frame (optional)

Step 9: Disconnect the hardware to be deleted

Step 10: Delete information from the SDR

Step 11: Set up system partitions (SP Switch only)

Step 12. Refresh authorization files in the system or in a system partition

|Step 13: Refresh RSCT subsystems

Step 14: Additional switch configuration

|Deleting an adapter from a node

|Step 1: Archive the SDR

|Step 2: Disable nodes from the switch

|Step 3: Reconfigure subsystems

|Step 4: Shutdown the node

|Step 5: Update DCE information for a node (required for DCE)

|Step 6: Delete switch adapters that connect nodes to the switch planes

|Step 7: Set node to customize

|Step 8: Verify installation settings

|Step 9: Run setup_server to configure the changes

|Step 10: Refresh RSCT subsystems

|Step 11: Reboot the node

|Step 12: Rejoin the nodes to the switch network

Replacing a node with an equivalent node

Step 1: Shut down the node and power it off

|Step 2: Security considerations

Step 3: Replace the old node with the new one and power it on

Step 4: Update the state of the supervisor microcode

Step 5: Unallocate NIM resources

Step 6: Delete the NIM client

Step 7: Acquire the hardware Ethernet address

Step 8: Set up nodes to be installed

Step 9: Network boot the new SP node

Step 10: Run post-installation procedures

Replacing a node with a different type of node

Adding an SP expansion I/O unit to an existing node

Step 1: Archive the SDR

Step 2: Shut down the node and power it off

Step 3: Install, cable, and power on the new SP expansion I/O unit

Step 4: Power on the node

Step 5: Verify the SP expansion I/O unit configuration

Removing an SP expansion I/O unit from an existing node

Step 1: Archive the SDR

Step 2: Shut down the node and power it off

Step 3: Disconnect and remove the SP expansion I/O unit

Step 4: Remove the SP expansion I/O unit definition from the SDR

Step 5: Power on the node

Moving an SP expansion I/O unit

Step 1: Archive the SDR

Step 2: Shut down the nodes and power them off

Step 3: Disconnect the SP expansion I/O unit from the old node and install it on the new node

Step 4: Remove the SP expansion I/O unit definition from the SDR

Step 5: Power on the node

Step 6: Verify the SP expansion I/O unit configuration

|Reconfiguring IBM e(logo)server pSeries 690 logical partitions (LPARs)

|Adding a new LPAR

|Deleting an existing LPAR

|Adding Resources to an LPAR

|Deleting Resources from an LPAR

|Changing modes of operation

Adding a switch

Adding a switch to a switchless system

Adding a switch to a system with existing switches

Upgrading the switches in your system

Prerequisites to transferring switches

Step 1: Prepare for the switch transfer

Step 2: Remove existing css0 device entries from the ODM

Step 3: Shut down all nodes and clean up the control workstation

Step 4: Replace a switch and switch adapters

Step 5: Update the SDR

Step 6: Update the state of the supervisor microcode

Step 7: Initialize switch information (SP Switch2 only)

Step 8: Annotate a switch topology file

Step 9: Set the switch primary and primary backup nodes

Step 10: Set the switch clock source for all switches (SP Switch only)

Step 11: Set up nodes to customize

Step 12: Power on the node

Step 13: Verify SP switch adapters

Step 14: Start the switch

Step 15: Run a verification test on the switch

Step 16: Reapply your system partition configuration (SP Switch only)

|Adding a switch plane (SP Switch2 only)

|Step 1: Quiesce your system

|Step 2: Install the new switch plane hardware

|Step 3: Update the state of the supervisor microcode

|Step 4: Configure the adapters for each node

|Step 5: Configure the aggregate IP interface for nodes (optional)

|Step 6: Reconfigure the number of switch planes on your system

|Step 7: Set up the new switch plane

|Step 8: Refresh RSCT subsystems

|Step 9: Set up nodes to customize

|Step 10: Reboot all nodes

|Step 11: Start up and verify the switch

Chapter 7. Performing software maintenance

Updating and maintaining installation images

Adding mksysb images to the control workstation

Restoring the control workstation from a mksysb image

Restoring the node from a mksysb image

Installing program updates

Before you begin

Choosing an approach

Preparing the control workstation

Installing updates on a per node basis

Installing updates through reinstallation

Chapter 8. Performing hardware maintenance

Replacing the frame supervisor

Step 1: Install the new frame supervisor card

Step 2: Reconfigure the hardware monitor to recognize the new hardware

Step 3: Update the state of the supervisor microcode

Step 4: Issue Eannotator

Step 5: Issue Eclock (SP Switch only)

Step 6: Issue Estart

Replacing a fixed disk

Step 1: Shut down the node

Step 2: Replace the disk

Step 3: Install the system image on the disk

Step 4: Network boot the node

Replacing a disk not in rootvg

Step 1: Shut down the node

Step 2: Replace the failing fixed disk

Step 3: Power on the node

Step 4: Restore any data previously backed-up

Replacing an I/O Planar card or an Ethernet adapter

Step 1: Shut down the node

Step 2: Replace the card

Step 3: Unallocate NIM resources

Step 4: Delete the NIM client

Step 5: Obtain the new hardware Ethernet address

Step 6: Re-create the NIM client definition

Changing Ethernet cable types

Step 1: Power off the nodes of the cable being replaced

Step 2: Replace the cable and recable your network

Step 3: Deallocate NIM resources

Step 4: Delete the NIM clients

Step 5: Change the Ethernet cable type entry in the SDR

Step 6: Set the affected nodes to customize and run setup_server

Step 7: Power on the nodes

Chapter 9. Installing the optional PSSP T/EC adapter

Chapter 10. Installing extension nodes

Control workstation steps

Extension node steps

Activate extension node step

Extension node verification steps

Appendix A. SAGE job descriptions

Core templates defined by SAGE

Junior system administrator

Intermediate/advanced system administrator

Additional skill areas

Appendix B. Directory information

Appendix C. SP Perspectives tasks

Starting and using Perspectives

Appendix D. Boot/install server configuration commands

Appendix E. User-supplied node customization scripts

How to use the node customization scripts

Migration and coexistence issues related to the node customization scripts

tuning.cust file

Appendix F. Overriding the PPSIZE in a mksysb image

Appendix G. Reserving ports

Procedures

Considerations for Network Information Service (NIS)

Resolving port number conflicts

Notices

Trademarks

Publicly Available Software

Specified Operating Environment

Hardware Specifications

Programming Specifications

Glossary of Terms and Abbreviations

Bibliography

Information formats

Finding documentation on the World Wide Web

Accessing PSSP documentation online

Manual pages for public code

RS/6000 SP planning publications

RS/6000 SP hardware publications

RS/6000 SP Switch Router publications

|Related hardware publications

RS/6000 SP software publications

Index

[ Top of Page | Previous Page | Next Page | Table of Contents | Index ]