lost SCSI connection 1

[aacheung]

I have 2 SCSI cards installed in V480, and each SCSI connects to a S1 in which the root disks are located, after power outage, I lost connection to disks in both S1
probe-scsi-all does not show the SCSI cards
boot cdrom -s and cfgadm -al only shows the c0 scsi-bus and the cd-rom
The SCSI cards and cables are still connected. Is that a hardware or software failure, any suggesion on how can I recover?
Thanks

 

[daFranze]

I suggest to set auto-boot? varaiable in OBP to false, reset and run
ok probe-scsi-all
again. You still can't see the devices?
Is it possible to boot the host from cdrom/net and see the devices in format, when the system ist up from cdrom/net?

Are you setting up this machine or did it happen after an upgrade/change/reboot?


Best Regards, Franz
--
UNIX System Manager from Munich, Germany

 

[aacheung]

I power cycle the S1 couple times.
I see the SCSI cards and external drive on S1 now, but format does not show those hard drives on S1 (3 Seagate on each S1) Are the disks on S1 corrupted? any way to recover?
Problem happened after a power outage.
Thanks


{3} ok probe-scsi-all
/pci@9,600000/SUNW,qlc@2
LiD HA LUN --- Port WWN --- ----- Disk description -----
1 1 0 21000000876b9751 HITACHI DK32EJ72FSUN72G 2Q0F
0 0 0 21000000876b977d HITACHI DK32EJ72FSUN72G 2Q0F
/pci@8,600000/pci@2/scsi@5
/pci@8,600000/pci@2/scsi@4
Target 0
Unit 0 Disk SEAGATE ST373307LSUN72G 0507
Target 1
Unit 0 Disk SEAGATE ST373307LSUN72G 0507
Target 2
Unit 0 Disk SEAGATE ST373307LSUN72G 0507
/pci@8,600000/pci@1/scsi@5
/pci@8,600000/pci@1/scsi@4
Target 0
Unit 0 Disk SEAGATE ST373307LSUN72G 0507
Target 1
Unit 0 Disk SEAGATE ST373307LSUN72G 0507
Target 2
Unit 0 Disk SEAGATE ST373307LSUN72G 0507

# format
Searching for disks...done
AVAILABLE DISK SELECTIONS:
0. c1t0d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
/pci@9,600000/SUNW,qlc@2/fp@0,0/ssd@w21000000876b977d,0
1. c1t1d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
/pci@9,600000/SUNW,qlc@2/fp@0,0/ssd@w21000000876b9751,0
Specify disk (enter its number):

 

[djr111]

have you just tried a 'devfsadm' to see if you can see them

 

[aacheung]

I boot off cdrom
# devfsadm
devfsadm: mkdir failed for /dev 0x1ed: Read-only file system
inst_sync failed for /etc/path_to_inst.313: Read-only file system
devfsadm: WARNING: failed to update /etc/path_to_inst

# format
Searching for disks...done
AVAILABLE DISK SELECTIONS:
0. c1t0d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
/pci@9,600000/SUNW,qlc@2/fp@0,0/ssd@w21000000876b977d,0
1. c1t1d0 <SUN72G cyl 14087 alt 2 hd 24 sec 424>
/pci@9,600000/SUNW,qlc@2/fp@0,0/ssd@w21000000876b9751,0

# mount /dev/dsk/c1t0d0s0 /a
# cd /a
# devfsadm
devfsadm: mkdir failed for /dev 0x1ed: Read-only file system
inst_sync failed for /etc/path_to_inst.321: Read-only file system
devfsadm: WARNING: failed to update /etc/path_to_inst

 

[djr111]

oh, thats right you said your root drives are on the S1.
I dn't think you can do 'devfsadm' from CD, since you are not actually running from one of the OS disks..

When you attempt to boot the system, how are you doing it? What error message do you get?

ok boot


maybe

ok boot diskX will work (replace X with a number)

 

[aacheung]

ok boot vx-rootdisk [or vx-rootmirror]
Resetting ...

Sun Fire 480R, No Keyboard
Copyright 1998-2004 Sun Microsystems, Inc. All rights reserved.
OpenBoot 4.13.0, 8192 MB memory installed, Serial #xxxxxxx.
Ethernet address 0:x:xx:xx:xx:xx, Host ID: xxxxxxxx.

Rebooting with command: boot vx-rootmirror
Boot device: /pci@8,600000/pci@2/scsi@4/sd@0,0 File and args:
SunOS Release 5.8 Version Generic_117350-13 64-bit
Copyright 1983-2003 Sun Microsystems, Inc. All rights reserved.
Starting VxVM restore daemon...
VxVM starting in boot mode...
NOTICE: vxvm:vxdmp: added disk array DISKS, datype = Disk

vxvm:vxconfigd: WARNING: Detaching plex rootvol-01 from volume rootvol
vxvm:vxconfigd: WARNING: Detaching plex rootvol-02 from volume rootvol
vxvm:vxconfigd: ERROR: Cannot start rootvol volume, no valid plexes
vxvm:vxconfigd: ERROR: System startup failed
syncing file systems... done
Program terminated
{0} ok ok boot cdrom -sr

 

[djr111]

First of all, I have never liked using Veritas for the root Drives, SVM for the root drives and Veritas for all other FS is what I prefer.


is this the same place you were at before?

You tried booting into multi-user mode, booting into single-user, does that fail also..im assuming yes.

Can you see the drives in format yet? if so...

looks like you might have a VXVM issue, you might want to try unencapsulating your root drives. Take a look at the 2 docs below, but be careful!!


hope this helps

http://support.veritas.com/docs/230661

http://support.veritas.com/docs/183905

 

[aacheung]

probe-scsi-all shows the drives in S1 with pci@8
but format only shows 2 drives with pci@9, which should be the 2 internal drives, so, format does not see the drives in S1

 

[coffeysm]

Well your first problem is you can not run devfsadm off the cd-rom the way you were. If you want to rebuild your device tree of the cd-rom you need to run:

mount /dev/dsk/c0t0d0s0 /mnt
devfsadm -p /mnt/etc/path_to_inst -r /mnt
reboot -- -rs
# To boot off regular drive
vi /mnt/etc/vfstab - Remove all /dev/vx entries here
vi /mnt/etc/system - Remove the rootdev entry and veritas
eeprom boot-device=disk
reboot -- -rs

 

[daFranze]

>> First of all, I have never liked using Veritas for the root Drives, SVM for the root drives and Veritas for all other FS is what I prefer.

so do I

>> probe-scsi-all shows the drives in S1 with pci@8
whenever the disks are visible in OBP and booted from cdrom there is no HW failure

as coffeysm suggested reduce your system to a system just booting the local disk. I suggest to disable veritas volume manager at all (while you are fixing this problem), lookup sunsolve.sun.com, there you can find some howtos. If your system does boot from local default disk: I suggest to rename /etc/path_to_inst and clean /dev and /devices and run a "boot -arv" from OBP. This will reconfigure all device entries. *pressing thumbs* (again sunsolve.sun.com is your friend)

Thought about running a restore of the boot disk!?

Best Regards, Franz
--
UNIX System Manager from Munich, Germany

 

[aacheung]

yes, coffeysm, I can see all drives under format now, THANKS!! trying to repair or fsck each drive before doing anything

 

[coffeysm]

Did you have Veritas setup to manage any other disks or file systems other then root?

 

[aacheung]

This is my disk setup
# vxdisk list
DEVICE TYPE DISK GROUP STATUS
c1t0d0s2 sliced rootdisk rootdg online
c1t1d0s2 sliced appdg01 appdg online
c1t2d0s2 sliced appdg02 appdg online
c2t0d0s2 sliced rootmirror rootdg online
c2t1d0s2 sliced appdg03 appdg online
c2t2d0s2 sliced appdg04 appdg online
c3t0d0s2 sliced disk01 rootdg online
c3t1d0s2 sliced disk02 rootdg online

modify vfstab & system file, reboot, get "Can't locate boot device", currently looking at vx problem

 

[coffeysm]

So, your other drives came up then with no problems? It seems to look that way from your output.

 

[aacheung]

I guess so, format and vxdisk list show all disks, and I believe that means I don't have any corrupted/failed disks
Thanks everyone for helping me to get into this state
I can boot disk, but not vx-rootdisk/vx-rootmirror, investigating now

 

[coffeysm]

Check your aliases in your OBP...devalias is the command I believe.

 

[aacheung]

devalias, printenv shows everything points to the right disk, I even specify boot vx-rootdisk at the OBP, but it still return Can't locate boot device

 

[coffeysm]

Beem awhile since I messed with this, but you might have to try something like this:

nvunalias vx-rootdisk
show-disks -It will provide a list-
nvalias ctrl + y vx-rootdisk

 

[aacheung]

ctrl +y returns 'devalias vx-rootdisk /pci@8,600000/pci@1/scsi@4/disk@0,0:a'

{3} ok nvunalias vx-rootdisk
{3} ok show-disks
a) /pci@9,600000/SUNW,qlc@2/fp@0,0/disk
b) /pci@8,600000/pci@2/scsi@5/sd
c) /pci@8,600000/pci@2/scsi@4/sd
d) /pci@8,600000/pci@1/scsi@5/sd
e) /pci@8,600000/pci@1/scsi@4/sd
f) /pci@8,700000/ide@6/cdrom
g) /pci@8,700000/ide@6/disk
q) NO SELECTION
Enter Selection, q to quit: q
{3} ok
{3} ok nvalias ctrl + y vx-rootdisk
{3} ok boot
Boot device: vx-rootmirror File and args:

Can't locate boot device

{3} ok nvalias devalias vx-rootdisk /pci@8,600000/pci@1/scsi@4/disk@0,0:a vx-rootdisk
{3} ok