IOS 2.2.2.3 - PH always missing on a reboot

[bdapriv01]

Hi

So I have IOS 2.2.2.3, running on a JS22 in a bladecenter S. The bladecenter S, sends 2 drives to the JS22. Both make up a storage pool, that I run the "VMs" from.

I can see the physical drives ok in IOS --

$ lspv
NAME PVID VG STATUS
hdisk0 0009300afbf100f9 rootvg active
hdisk1 0009300a48ab6b0f sp1 active
hdisk2 0009300a48ab6bf9 sp1 active
$

On a reboot, the hdisk2, is always "missing", and as a result, the VG won't come up --

$ lspv hdisk2
PHYSICAL VOLUME: hdisk2 VOLUME GROUP: sp1
PV IDENTIFIER: 0009300a48ab6bf9 VG IDENTIFIER 0009300a0000d4000000013fcf56bb2e
PV STATE: [highlight #FCE94F]missing[/highlight][highlight #FCE94F][/highlight]
STALE PARTITIONS: 0 ALLOCATABLE: yes
PP SIZE: 256 megabyte(s) LOGICAL VOLUMES: 1
TOTAL PPs: 1862 (476672 megabytes) VG DESCRIPTORS: 1
FREE PPs: 1382 (353792 megabytes) HOT SPARE: no
USED PPs: 480 (122880 megabytes) MAX REQUEST: 256 kilobytes
FREE DISTRIBUTION: 373..00..264..372..373
USED DISTRIBUTION: 00..372..108..00..00
MIRROR POOL: None
$

The other disk is ok --

$ lspv hdisk1
PHYSICAL VOLUME: hdisk1 VOLUME GROUP: sp1
PV IDENTIFIER: 0009300a48ab6b0f VG IDENTIFIER 0009300a0000d4000000013fcf56bb2e
PV STATE: active
STALE PARTITIONS: 0 ALLOCATABLE: yes
PP SIZE: 256 megabyte(s) LOGICAL VOLUMES: 2
TOTAL PPs: 1862 (476672 megabytes) VG DESCRIPTORS: 2
FREE PPs: 222 (56832 megabytes) HOT SPARE: no
USED PPs: 1640 (419840 megabytes) MAX REQUEST: 256 kilobytes
FREE DISTRIBUTION: 00..01..00..00..221
USED DISTRIBUTION: 373..371..372..372..152
MIRROR POOL: None
$

If I mark the hdisk2 as removed, then add it - it works. Any idea why?

# chpv -vr hdisk2
# chpv -va hdisk2
0516-1010 chpv: Warning, the physical volume hdisk2 has open logical
volumes. Continuing with change.
# lspv hdisk2
PHYSICAL VOLUME: hdisk2 VOLUME GROUP: sp1
PV IDENTIFIER: 0009300a48ab6bf9 VG IDENTIFIER 0009300a0000d4000000013fcf56bb2e
PV STATE: [highlight #FCE94F]active[/highlight]
STALE PARTITIONS: 0 ALLOCATABLE: yes
PP SIZE: 256 megabyte(s) LOGICAL VOLUMES: 1
TOTAL PPs: 1862 (476672 megabytes) VG DESCRIPTORS: 1
FREE PPs: 1382 (353792 megabytes) HOT SPARE: no
USED PPs: 480 (122880 megabytes) MAX REQUEST: 256 kilobytes
FREE DISTRIBUTION: 373..00..264..372..373
USED DISTRIBUTION: 00..372..108..00..00
MIRROR POOL: None
#

 

[AIXLogician]

What do you see at the error report?
Are hdisk1 and hdisk2 internal disks? or SAN connected?
If internal check the disk in diag.

If external check the path and connect with Storage team to determine the root cause.

 

[bdapriv01]

They are connected via an SAS switch inside the bladecenter.

This is whats in the error log -- the disks all look fine?

Sean


IDENTIFIER TIMESTAMP T C RESOURCE_NAME DESCRIPTION
F7DDA124 1007144513 U H LVDD PHYSICAL VOLUME DECLARED MISSING
A6DF45AA 1007143513 I O RMCdaemon The daemon is started.
5BEAD71B 1007143413 I S LIBLVM Activation of a no quorum volume group w
26120107 1007143413 U S LIBLVM PHYSICAL VOLUME DEFINED AS MISSING
2BFA76F6 1007143313 T S SYSPROC SYSTEM SHUTDOWN BY USER

 

[AIXLogician]

Yes, I do see it is throwing some errors for disk, ok do this

Paste the output of the below
errpt -aj F7DDA124
errpt -aj 26120107