Linux on IBM Power5 ( Raid , Bonding Problem )

[AIX5L]

Hi

Has anybody experience with RHEL 4.0 and SLES 9.0 on P5 ?
I have Problems with the bonding Device with 2 VIO Servers to bring up the Interfaces in the arp Monitoring Mode.

What is the best way to resync/recreate the Linux RAID1 Mirror when 1 Mirror( VIO-Server ) will go down ?

Even i reboot one VIO-Server my Raid looks like this:

md2 : active raid1 sdb1[0]
10485632 blocks [2/1] [U_]
where is sdd1 ?
md1 : active raid1 sdc4[1]
9825216 blocks [2/1] [_U]
where is sda4 ?

md0 : inactive
unused devices: <none>

Why is my md0 inavtive ( swap ) ?
/dev/sda3 and /dev/sdc3


linux:/data # fdisk -l /dev/sda

Disk /dev/sda: 10.7 GB, 10737418240 bytes
64 heads, 32 sectors/track, 10240 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Device Boot Start End Blocks Id System
/dev/sda1 * 1 11 11248 6 FAT16
/dev/sda2 12 132 123904 83 Linux
/dev/sda3 133 645 525312 fd Linux raid autodetect
/dev/sda4 646 10240 9825280 fd Linux raid autodetect


linux:/data # fdisk -l /dev/sdc

Disk /dev/sdc: 10.7 GB, 10737418240 bytes
64 heads, 32 sectors/track, 10240 cylinders
Units = cylinders of 2048 * 512 = 1048576 bytes

Device Boot Start End Blocks Id System
/dev/sdc1 1 11 11248 41 PPC PReP Boot
/dev/sdc2 12 132 123904 83 Linux
/dev/sdc3 133 645 525312 fd Linux raid autodetect
/dev/sdc4 646 10240 9825280 fd Linux raid autodetect


sda is on vio1
sdc is on vio2
both are SAN Disks direct attached over vscsi ( no lv )

If i reboot my LPAR:

dmesg:

SCSI error : <0 0 1 0> return code = 0x6000000
end_request: I/O error, dev sda, sector 20971472
Buffer I/O error on device sda4, logical block 2456314
md: could not lock sda4.
md: error, md_import_device() returned -16
md: raidstart(pid 986) used deprecated START_ARRAY ioctl. This will not be supported beyond 2.6
md: could not lock sda4.
md: could not import sda4!
device-mapper: 4.3.0-ioctl (2004-09-30) initialised: dm-devel@redhat.com
md: autostart unknown-block(0,2052) failed!
md: Autodetecting RAID arrays.
md: could not lock sda4.
md: could not import sda4!
md: autorun ...
md: considering sdd1 ...
md: adding sdd1 ...
md: sdc4 has different UUID to sdd1
md: sdc3 has different UUID to sdd1
md: adding sdb1 ...
md: sda3 has different UUID to sdd1
md: created md2
md: bind<sdb1>
md: bind<sdd1>
md: running: <sdd1><sdb1>
md: kicking non-fresh sdd1 from array!
md: unbind<sdd1>
md: export_rdev(sdd1)
md: raid1 personality registered as nr 3
raid1: raid set md2 active with 1 out of 2 mirrors
md: considering sdc4 ...
md: adding sdc4 ...
md: sdc3 has different UUID to sdc4
md: sda3 has different UUID to sdc4
md: created md1
md: bind<sdc4>
md: running: <sdc4>
raid1: raid set md1 active with 1 out of 2 mirrors
md: considering sdc3 ...
md: adding sdc3 ...
md: adding sda3 ...
md: md0 already running, cannot run sdc3
md: export_rdev(sda3)
md: export_rdev(sdc3)
md: ... autorun DONE.

 

[Mag0007]

Try asking in the AIX forums.

 

[Chacalinc]

Mag0007: the question is regarding RHEL 4.0 and SLES 9.0 on P5, not AIX.

Chacal, Inc.

 

[AIX5L]

Hi

I hope anybody can help me.
I'm an AIX Engineer and i want to see if Linux is Buisiness Ready on IBM Power ;->

 

[Mag0007]

Chacalnic: Correct I know

Usually, you would need to allocate 2 eth thru HMC. The AIX people may have more details on howto do it.

 

[Mag0007]

Chacalnic:

Sorry, I though you were asking about building a Virtual Ethernet, nothing about RAID.

Sorry!!

AIX5l: Linux isn't even close to to AIX. Will be there...i hope

 

[Chacalinc]

Mag0007: this is a AIX5L's question, not mine, but you know, with my hand over my heart, linux -next to AIX- is a toy.

AIX5L: I think this question is quite hard even for us, I'm pretty sure that all guys who have P5 servers will use AIX rather than Linux, after all P5's developer had (I guess) AIX in mind and not linux.

I really hope to be wrong, but I have no answer for this, sorry

Cheers.

Chacal, Inc.

 

[AIX5L]

Hi

Ok for the Linux Micky Mouse OS Guys ;->
I do the LPI Certification but Linux is not my prefered unix .

I have a Problem with Bonding in arp Mode:
I have configured 2 Virtual Adapters ( they are shared on the VIO Server with separate VLAN Tags/PVID )
If i create a bond0 Device with Linkstate Mode the Channel will work, but it doens't detect if one VIO-Server goes down. ( i loos 50% of Packets )

Problem 2:
If loos my Disks in my Raidconfiguration if one vio-server goes down.
Can anybody give my some input ( steps ) to resynchronise the mirror ?

 

[Chacalinc]

in order to rebuild a software RAID you must use [tt]raidhotadd[/tt].

take a look to:

http://www.redhat.com/docs/manuals/...1-storage-rhlspec.html#S2-STORAGE-RAID-CREDEL

point 5.9.9.2

Hope this helps.

Chacal, Inc.

 

[AIX5L]

Hi

linux:/data # raidhotadd /dev/md1 sda4

will hang....

Jul 11 23:07:36 linux kernel: md: trying to hot-add sda4 to md1 ...
Jul 11 23:07:36 linux kernel: md: could not lock sda4.
Jul 11 23:07:36 linux kernel: md: error, md_import_device() returned -16
Jul 11 23:07:49 linux kernel: md: trying to hot-add md1 to md1 ...

 

[AIX5L]

Can anybody help here in this forum ?

 

[Mag0007]

RAID question on your system:
Are you hoooked up to a SAN? If your SAN has your LUNs mirrored, don't bother using Linux's RAID features. You should just see a physical disk if you are set up correctly.

 

[AIX5L]

YES/NO The Disk are in the SAN, but are bridged trough a virtual I/O Server.

My Disks looks like normal scsi Disks.
I have two Storage Servers in my SAN and everyone will map 1 Volume to my Linux Partition.
I wont to mirror my OS over this 2 Volumes( Partitions )
After the First Installation the RAID was UP and both Volumes assigned. Then i Shutdown one vio-server ( 1 Disk will go away ). After that i saw my Disk /dev/sda4 as removed. After a reboot the this is no longer in the Raidmap........