05/22/96 Recovery from LED 551, 555, or 557 in AIX 4.1 SPECIAL NOTICES Information in this document is correct to the best of our knowledge at the time of this writing. Please send feedback by fax to "AIXServ Information" at (512) 823-4009. Please use this information with care. IBM will not be responsible for damages of any kind resulting from its use. The use of this information is the sole responsibility of the customer and depends on the customer's ability to eval- uate and integrate this information into the customer's operational environment. WARNING: Please do not use this document if the system is a /usr client, diskless client, or dataless client. WARNING: Do not use this procedure on an AFS fileserver. Doing so may remove all AFS fileserver data because fsck would be run on the AFS volumes. ABOUT THIS DOCUMENT This document describes the causes for LED 551, 555 or 557 during IPL on a RISC System/6000. Also outlined is a recovery procedure. This document is applicable to AIX 4.1. CAUSES OF AN LED 551, 555, OR 557 The known causes of an LED 551, 555, or 557 during IPL on an RISC System/6000 are: o A corrupted file system. o A corrupted journaled-file-system (JFS) log device. o A failing fsck (file-system check) caused by a bad file system helper. o A bad disk in the machine that is a member of the rootvg. RECOVERY PROCEDURE To diagnose and fix the problem, you will need to boot from bootable media, run logform on /dev/hd8, and run fsck to fix any file systems that may be corrupted. WARNING: Please do not use this document if the system is a /usr client, diskless client, or dataless client. 1. Turn the key to the Service position. 2. With BOOTABLE MEDIA OF THE SAME VERSION AND LEVEL AS THE SYSTEM, boot the system. The bootable media can be ANY ONE of the following Recovery from LED 551, 555, or 557 in AIX 4.1 1 05/22/96 o Bootable cdrom o NON_AUTOINSTALL Mksysb o Bootable Install Tape Follow the screen prompts to the following menu: Welcome to Base Operating System Installation and Maintenance 3. Choose "Start Maintenance Mode for System Recovery" (Option 3). The Next Screen has the "maintenance" Menu. o Choose "Access a Root Volume Group" (Option 1). The next screen displays a warning that indicates you will not be able to return to Base OS menu without rebooting. o Choose "0 continue" The next screen displays information about all volume groups on the system. o Select the root volume group by number. o Choose "Access this volume group and start a shell before mounting the filesystems" (Option 2). If you get errors indicating that a physical volume is missing from the rootvg, run diagnostics on the physical volumes to find out if you have a bad disk. Do not con- tinue with the rest of the steps in this document. If you get other errors from the above option, do not continue with the rest of the steps in this document. Correct the problem causing the error. If you need assistance correcting the problem contact one of the following: o local branch office o your point of sale o call 1-800-CALL-AIX (to register for fee-based ser- vices) All of the above avenues for assistance may be billable. | 4. Format the default jfslog for the rootvg jfs file systems. /usr/sbin/logform /dev/hd8 Answer "yes" when asked if you want to destroy the log. Recovery from LED 551, 555, or 557 in AIX 4.1 2 05/22/96 5. Next, run the following commands to check and repair file systems. (The "-y" option gives fsck permission to repair file systems when necessary.) fsck -y /dev/hd1 fsck -y /dev/hd2 fsck -y /dev/hd3 fsck -y /dev/hd4 fsck -y /dev/hd9var 6. Type "exit". The file systems will automatically mount after you type "exit". 7. If you are running the Andrew File System (AFS), use the following commands to find out whether you have more | than one version of the v3fshelper file. (otherwise | skip to step 8.) cd /sbin/helpers ls -l v3fshelper* If you have only one version of the v3fshelper file (for | example, "v3fshelper"), proceed to step 8. If there is a version of v3fshelper marked as original (for example, "v3fshelper.orig"), run the following com- mands: copy v3fshelper v3fshelper.afs copy v3fshelper.orig v3fshelper 8. Determine which disk is the boot disk with the lslv command. The boot disk will be shown in the PV1 column of the lslv output. lslv -m hd5 WARNING: Please do not proceed further if the system is a /usr client, diskless client, or dataless client. 9. Recreate the boot image and alter the boot list. | (hdisk# is the boot disk determined in step 8.) bosboot -a -d /dev/hdisk# bootlist -m normal hdisk# | 10. If you copied the v3fshelper file in step 7, AFS file- system helper back to v3fshelper: copy v3fshelper.afs v3fshelper 11. With the key in Normal position, run shutdown -Fr If you followed all of the above steps and the system still stops at an LED 551, 555, or 557 during a reboot in normal mode, you may want to pursue further system recovery assistance from one of the following: Recovery from LED 551, 555, or 557 in AIX 4.1 3 05/22/96 o local branch office o your point of sale o 1-800-CALL-AIX (to register for fee-based services) All of the above avenues for assistance may be billable. For reasons of time and the integrity of your AIX oper- ating system, the best alternative at this point may be to reinstall AIX. Recovery from LED 551, 555, or 557 in AIX 4.1 4 05/22/96 READER'S COMMENTS Please fax this form to (512) 823-4009, attention "AIXServ Informa- tion". You may also e-mail comments to: elizabet@austin.ibm.com. These comments should include the same customer information requested below. Use this form to tell us what you think about this document. If you have found errors in it, or if you want to express your opinion about it (such as organization, subject matter, appearance) or make sug- gestions for improvement, this is the form to use. If you need technical assistance, contact your local branch office, point of sale, or 1-800-CALL-AIX (for information about support offer- ings). These services may be billable. Faxes on a variety of sub- jects may be ordered free of charge from 1-800-IBM-4FAX. Outside the U.S. call 415-855-4329 using a fax machine phone. When you send comments to IBM, you grant IBM a nonexclusive right to use or distribute your comments in any way it believes appropriate without incurring any obligation to you. NOTE: If you have a problem report or item number, supplying that number may help us determine why a procedure did or did not work in your specific situation. Problem Report or Item #: Branch Office or Customer #: Be sure to print your name and fax number below if you would like a reply: Name: Fax Number: ______________________________________________________________________ ______________________________________________________________________ ______________________________________________________________________ ______________________________________________________________________ ______________________________________________________________________ ______________________________________________________________________ ______________________________________________________________________ ______________________________________________________________________ ______________________________________________________________________ ______________________________________________________________________ ______________________________________________________________________ ______________________________________________________________________ END OF DOCUMENT (led551.41.krn, 4FAX# 4190) Recovery from LED 551, 555, or 557 in AIX 4.1 5