On the lspv output I noticed 4 of 8 hdiskpower devices without PVIDs - those PVIDs are now seen on plane EMC's hdisk devices. But then I check in "powermt display dev=all" I see all hdiskpower devices with complete number of paths (corresponding hdiskX devices). Also lsdev -Cc disk shows all hdiskpower and EMC's plane hdisks available. No changes were done on system side since several weeks so I am surprised what could happen..
Anyone has an idea what could happen and how to fix it online (service can't be stopped right now)?
The system is AIX 5.3 TL11 SP4
EMC ODM and Powerpath 5.3
Code:
# lspv|grep -v rootvg
hdisk2 none None
hdisk3 none None
hdisk4 none None
hdisk5 none None
hdisk6 none None
hdisk7 none None
hdisk8 00cb17c321ea8bc4 appvg active
hdisk9 00cb17c321ae63fe appvg active
hdisk10 00cb17c321e166d0 appvg active
hdisk11 00cb17c321e44bab appvg active
hdisk12 none None
hdisk13 none None
hdisk14 none None
hdisk15 none None
hdisk16 none None
hdisk17 none None
hdisk18 00cb17c321ea8bc4 appvg active
hdisk19 00cb17c321ae63fe appvg active
hdisk20 00cb17c321e166d0 appvg active
hdisk21 00cb17c321e44bab appvg active
hdiskpower0 00cb17c321e8aead appvg active
hdiskpower1 00cb17c321ec5833 appvg active
hdiskpower2 00cb17c321afbb20 appvg active
hdiskpower3 00cb17c321e28009 appvg active
hdiskpower4 00cb17c321e57632 appvg active
hdiskpower5 00cb17c321e7e965 appvg active
hdiskpower6 none None
hdiskpower7 none None
hdiskpower8 none None
hdiskpower9 none None
# lsdev -Cc disk
hdisk0 Available 00-08-00 SAS Disk Drive
hdisk1 Available 00-08-00 SAS Disk Drive
hdisk2 Available 07-01-02 EMC Symmetrix FCP VRAID
hdisk3 Available 07-01-02 EMC Symmetrix FCP VRAID
hdisk4 Available 07-01-02 EMC Symmetrix FCP VRAID
hdisk5 Available 07-01-02 EMC Symmetrix FCP VRAID
hdisk6 Available 07-01-02 EMC Symmetrix FCP VRAID
hdisk7 Available 07-01-02 EMC Symmetrix FCP VRAID
hdisk8 Available 07-01-02 EMC Symmetrix FCP VRAID
hdisk9 Available 07-01-02 EMC Symmetrix FCP VRAID
hdisk10 Available 07-01-02 EMC Symmetrix FCP VRAID
hdisk11 Available 07-01-02 EMC Symmetrix FCP VRAID
hdisk12 Available 04-01-02 EMC Symmetrix FCP VRAID
hdisk13 Available 04-01-02 EMC Symmetrix FCP VRAID
hdisk14 Available 04-01-02 EMC Symmetrix FCP VRAID
hdisk15 Available 04-01-02 EMC Symmetrix FCP VRAID
hdisk16 Available 04-01-02 EMC Symmetrix FCP VRAID
hdisk17 Available 04-01-02 EMC Symmetrix FCP VRAID
hdisk18 Available 04-01-02 EMC Symmetrix FCP VRAID
hdisk19 Available 04-01-02 EMC Symmetrix FCP VRAID
hdisk20 Available 04-01-02 EMC Symmetrix FCP VRAID
hdisk21 Available 04-01-02 EMC Symmetrix FCP VRAID
hdiskpower0 Available 04-01-02 PowerPath Device
hdiskpower1 Available 04-01-02 PowerPath Device
hdiskpower2 Available 04-01-02 PowerPath Device
hdiskpower3 Available 04-01-02 PowerPath Device
hdiskpower4 Available 04-01-02 PowerPath Device
hdiskpower5 Available 04-01-02 PowerPath Device
hdiskpower6 Available 04-01-02 PowerPath Device
hdiskpower7 Available 04-01-02 PowerPath Device
hdiskpower8 Available 04-01-02 PowerPath Device
hdiskpower9 Available 04-01-02 PowerPath Device
# powermt display dev=all | grep -p power[6,7,8,9]
Pseudo name=hdiskpower6
Symmetrix ID=000211221213
Logical device ID=091A
state=alive; policy=SymmOpt; priority=0; queued-IOs=0
==============================================================================
---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================================================
0 fscsi1 hdisk18 FA 11gA active alive 0 0
1 fscsi3 hdisk8 FA 7gA active alive 0 0
Pseudo name=hdiskpower7
Symmetrix ID=000211221213
Logical device ID=091B
state=alive; policy=SymmOpt; priority=0; queued-IOs=0
==============================================================================
---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================================================
0 fscsi1 hdisk19 FA 11gA active alive 0 0
1 fscsi3 hdisk9 FA 7gA active alive 0 0
Pseudo name=hdiskpower8
Symmetrix ID=000211221213
Logical device ID=091C
state=alive; policy=SymmOpt; priority=0; queued-IOs=0
==============================================================================
---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================================================
0 fscsi1 hdisk20 FA 11gA active alive 0 0
1 fscsi3 hdisk10 FA 7gA active alive 0 0
Pseudo name=hdiskpower9
Symmetrix ID=000211221213
Logical device ID=091D
state=alive; policy=SymmOpt; priority=0; queued-IOs=0
==============================================================================
---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================================================
0 fscsi1 hdisk21 FA 11gA active alive 0 0
1 fscsi3 hdisk11 FA 7gA active alive 0 0Anyone has an idea what could happen and how to fix it online (service can't be stopped right now)?
The system is AIX 5.3 TL11 SP4
EMC ODM and Powerpath 5.3