09/04/96 Recovery from an LED 553 in AIX 4.1 SPECIAL NOTICES Information in this document is correct to the best of our knowledge at the time of this writing. Please send feedback by fax to "AIXServ Information" at (512) 823-4009. Please use this information with care. IBM will not be responsible for damages of any kind resulting from its use. The use of this information is the sole responsibility of the customer and depends on the customer's ability to eval- uate and integrate this information into the customer's operational environment. ABOUT THIS DOCUMENT This document sets out a procedure to recover from an LED 553 and is applicable to AIX 4.1. ABOUT LED 553 An LED 553 occurs during IPL on a RISC System/6000 if the system cannot read or run the /etc/inittab file. To recover from an LED 553, check /dev/hd3 and /dev/hd4 for space problems, and erase files if necessary. Check the /etc/inittab file for corruption, and fix it if necessary. If the inittab file was not corrupted, you will need to check the shell profiles, the /bin/bsh file, and some other files. RECOVERY PROCEDURE 1. Turn the key to the Service position. 2. With BOOTABLE MEDIA OF THE SAME VERSION AND LEVEL AS THE SYSTEM, boot the system. The bootable media can be ANY ONE of the following o Bootable cdrom o Mksysb o Bootable Install Tape Follow the prompts to the "Welcome to Base OS" menu. 3. Choose "Start Maintenance Mode for System Recovery" (Option 3) The Next Screen would prompt the following Menu "Mainte- nance" o Choose "Access a Root Volume Group" (Option 1) Recovery from an LED 553 in AIX 4.1 1 09/04/96 At this stage the console would display information about rootvg, and also Display a Menu with two Options. o Choose "Access this volume group and start a shell" (Option 1) If you get errors from the above option, do not continue with the rest of this procedure. Correct the problem causing the error. If you need assistance correcting the problem causing the error, contact one of the fol- lowing: o local branch office o your point of sale o 1-800-CALL-AIX (to register for fee-based services) All of the above avenues for assistance may be billable. 4. Use the df command to check for free space in /dev/hd3 and /dev/hd4. df /dev/hd3 df /dev/hd4 5. If df showed that either file system is out of space, erase some files from that file system. Three files you may want to erase are /smit.log, /smit.script, and /.sh_history. 6. Next, check the /etc/inittab file for corruption. It may be empty or missing, or it may have an incorrect entry. For comparison, see "Sample /etc/inittab Files" at the end of this document. 7. If the inittab file is corrupt, set your terminal type in preparation for editing the file. (xxx is a terminal type, such as lft, ibm3151, or vt100.) TERM=xxx export TERM Now use an editor to create the /etc/inittab file. For an example, see "Sample /etc/inittab Files" at the end of this document. If your /etc/inittab file was corrupt and you recreated it, you may not need to perform any of the following steps. 8. Use the following command to check for any modifications or problems with permission. ls -al /.profile /etc/environment /etc/profile Example output: -rw-r--r-- 1 root system 158 Dec 14 1993 /.profile -rw-rw-r-- 1 root system 1389 Oct 26 1993 /etc/environment -rw-r--r-- 1 root system 1214 Jan 22 1993 /etc/profile Recovery from an LED 553 in AIX 4.1 2 09/04/96 One of the above files may contain a command that is valid only in the Korn shell. Change the command to something that is also valid in the Bourne shell. For example, change export PATH=/bin:/usr/bin/:/etc:/usr/ucb:. to PATH=/bin:/usr/bin/:/etc:/usr/ucb:. export PATH 9. Check for missing or moved files with the following command: | ls -al /bin /bin/bsh /bin/sh /lib /u /unix Example output lrwxrwxrwx 1 root sys 8 Aug 5 1994 /bin -> /usr/bin -r-xr-xr-x 3 bin bin 256224 Jun 4 1993 /bin/bsh -r-xr-xr-x 3 bin bin 256224 Jun 4 1993 /bin/sh | lrwxrwxrwx 1 root sys 8 Aug 5 1994 /lib -> /usr/lib lrwxrwxrwx 1 root sys 5 Aug 5 1994 /u -> /home lrwxrwxrwx 1 root sys 18 Aug 5 1994 /unix -> /usr/lib/boot/unix If any of the above files are missing, the problem may be a missing symbolic link. Use the commands from the list below that correspond to the missing links. ln -s /usr/bin /bin ln -s /usr/lib/boot/unix /unix | ln -s /usr/lib /lib ln -s /home /u 10. Use the following command to make sure that fsck and rc.boot are not missing or corrupt. ls -l /etc/fsck /sbin/rc.boot Example output- lrwxrwxrwx 1 root system 14 Aug 5 1994 /etc/fsck -> /usr/sbin/fsck -rwxrwxr-- 1 root system 33760 Aug 30 1993 /sbin/rc.boot 11. Make sure the /etc/inittab file is the 4.1 version. For that version, the line that begins with "brc" should be brc::sysinit:/sbin/rc.boot 3 >/dev/console 2>&1 See "Sample /etc/inittab Files" at the end of this docu- ment for an example. 12. If you have not found any obvious problems, try substi- tuting ksh for bsh with the following commands. (The first command saves your bsh before you copy over it.) cp /bin/bsh /bin/bsh.orig cp /bin/ksh /bin/bsh Recovery from an LED 553 in AIX 4.1 3 09/04/96 If you can then reboot successfully, you know that one of the profiles was causing problems for bsh. Check the profiles again by running the following: /bin/bsh.orig /.profile /bin/bsh.orig /etc/profile /bin/bsh.orig /etc/environment If you receive errors with any of the above commands, you know there is a command in that profile that bsh cannot handle. If you followed all of the above steps and the system still stops at an LED 553 during a reboot in Normal mode, you may want to pursue further system recovery assistance from one of the following- o local branch office o your point of sale o 1-800-CALL-AIX (to register for fee-based services) All of the above avenues for assistance may be billable. For reasons of time and the integrity of your AIX operating system, the best alternative at this point may be to reinstall AIX. SAMPLE /ETC/INITTAB FILE FOR AIX 4.1 :@(#)49 1.28.2.7 src/bos/etc/inittab,cmdoper,bos411, : 9430C411a 7/26/94 16.27.45 init:2:initdefault: brc::sysinit:/sbin/rc.boot 3 >/dev/console 2>&1 # Phase 3 of system boot powerfail::powerfail:/etc/rc.powerfail 2>&1 | alog -tboot > /dev/console rc:2:wait:/etc/rc > alog -tboot > /dev/console 2>&1 # Multi-User checks fbcheck:2:wait:/usr/lib/dwm/fbcheck > alog -tboot >/dev/console 2>&1 srcmstr:2:respawn:/etc/srcmstr # System Resource Controller rctcpip:2:wait:/etc/rc.tcpip > /dev/console 2> &1 # Start TCP/IP daemons rcnfs:2:wait:/etc/rc.nfs > /dev/console 2>&1 # Start NFS Daemons cron:2:respawn:/etc/cron cons:0123456789:respawn:/etc/getty /dev/console piobe:2:wait:/usr/lib/lpd/pio/etc/pioinit > /dev/null 2>&1 # pb cleanup qdaemon:2:wait:/bin/startsrc -sqdaemon writesrv:2:wait:/bin/startsrc -swritesrv uprintfd:2:respawn:/usr/sbin/uprintfd dt:2:wait:/etc/rc.dt Recovery from an LED 553 in AIX 4.1 4 09/04/96 READER'S COMMENTS Please fax this form to (512) 823-4009, attention "AIXServ Informa- tion". You may also e-mail comments to: elizabet@austin.ibm.com. These comments should include the same customer information requested below. Use this form to tell us what you think about this document. If you have found errors in it, or if you want to express your opinion about it (such as organization, subject matter, appearance) or make sug- gestions for improvement, this is the form to use. If you need technical assistance, contact your local branch office, point of sale, or 1-800-CALL-AIX (for information about support offer- ings). These services may be billable. Faxes on a variety of sub- jects may be ordered free of charge from 1-800-IBM-4FAX. Outside the U.S. call 415-855-4329 using a fax machine phone. When you send comments to IBM, you grant IBM a nonexclusive right to use or distribute your comments in any way it believes appropriate without incurring any obligation to you. NOTE: If you have a problem report or item number, supplying that number may help us determine why a procedure did or did not work in your specific situation. Problem Report or Item #: Branch Office or Customer #: Be sure to print your name and fax number below if you would like a reply: Name: Fax Number: ______________________________________________________________________ ______________________________________________________________________ ______________________________________________________________________ ______________________________________________________________________ ______________________________________________________________________ ______________________________________________________________________ ______________________________________________________________________ ______________________________________________________________________ ______________________________________________________________________ ______________________________________________________________________ ______________________________________________________________________ ______________________________________________________________________ END OF DOCUMENT (led553.41.krn, 4FAX# 4191) Recovery from an LED 553 in AIX 4.1 5