AIX 5.3 : performance's analyze

[YER]

Hello,

I'm new on AIX and I would like to tun an AIX server.

from a topas command, I have the following result:

Topas Monitor for host: S_PROD
Tue Feb 13 13:56:01 2007 Interval: 2

Kernel 3.6 |## |
User 94.7 |########################### |
Wait 1.7 |# |
Idle 0.0 | |


EVENTS/QUEUES FILE/TTY
Cswitch 1739 Readch 3174.5K
Syscall 932 Writech 3550.4K
Reads 153 Rawin 0
Writes 70 Ttyout 723
Forks 0 Igets 0
Execs 0 Namei 3
Runqueue 3.5 Dirblk 0
Waitqueue 9.0

PAGING MEMORY
Faults 717 Real,MB 5760
Steals 128 % Comp 83.4
PgspIn 528 % Noncomp 17.4
PgspOut 42 % Client 17.9
PageIn 1362
PageOut 608 PAGING SPACE
Sios 1840 Size,MB 8448
% Used 55.5
NFS (calls/sec) % Free 44.4
ServerV2 0
ClientV2 0 Press:
ServerV3 0 "h" for help
ClientV3 0 "q" to quit


Network KBPS I-Pack O-Pack KB-In KB-Out
en2 31.4 68.0 45.5 17.1 14.3
en0 2.4 7.5 11.0 0.8 1.6
en1 0.8 7.0 0.0 0.8 0.0
lo0 0.0 0.0 0.0 0.0 0.0

Disk Busy% KBPS TPS KB-Read KB-Writ
hdisk0 0.0 1246.0 279.0 1076.0 170.0
dac1 0.0 0.0 0.0 0.0 0.0
dac1-utm 0.0 0.0 0.0 0.0 0.0
dac0 0.0 0.0 0.0 0.0 0.0
dac0-utm 0.0 0.0 0.0 0.0 0.0
hdisk1 0.0 1212.0 270.5 1042.0 170.0
dac3 0.0 0.0 0.0 0.0 0.0
cd0 0.0 0.0 0.0 0.0 0.0
dac3-utm 0.0 0.0 0.0 0.0 0.0
dac2 0.0 5939.2 105.0 2327.5 3611.8
dac2-utm 0.0 0.0 0.0 0.0 0.0
hdisk2 0.0 5939.2 105.0 2327.5 3611.8



Name PID CPU% PgSp Owner
oracle 2211954 49.1 5.1 oracle9i
oracle 2519102 49.1 4.6 oracle9i
oracle 1478798 4.4 4.6 oracle9i
oracle 1122444 1.4 9.5 oracle9i
oracle 1208420 1.3 15.5 oracle9i
oracle 1769574 0.8 7.5 oracle9i
oracle 1339464 0.7 4.2 oracle9i
aioserve 524386 0.6 0.1 root
aioserve 188466 0.6 0.1 root
oracle 1187988 0.6 7.7 oracle9i
oracle 1364078 0.5 8.0 oracle9i
oracle 1232924 0.5 4.2 oracle9i
aioserve 569396 0.3 0.1 root
oracle 1007768 0.3 5.8 oracle9i
Signal 2 received

What will I do for this situation?

Regards

 

[khalidaaa]

What version of AIX is that?

How many CPUs do you have in this system?

It seems that you are having a CPU bottleneck! the run queue shows that they are 3.5 jobs waiting fot the CPU to be free which is not good indication!

I can see that your memory is 83% utilized for computational and it seems that you have some paging going on! I'm not sure if that is having a problem or not coz it depends on how often paging is going on! paging space is 55% utilized!

what are those two jobs doing?

oracle 2211954 49.1 5.1 oracle9i
oracle 2519102 49.1 4.6 oracle9i

Have you ever tried to tune memory? show us what you've done?

vmo -L

run vmstat 1 for some time and then paste the output

Regards,
Khalid

 

[khalidaaa]

http://publib.boulder.ibm.com/infoc...?topic=/com.ibm.aix.cmds/doc/aixcmds6/vmo.htm

 

[YER]

AIX 5L Version 5.3, turning on one CPU.

those two jobs is an Oracle jobs. they is turning automaticaly each 1hour.

I don't never use a command to tune memory. And I have no idee what I must do. Just, I see that the system is very busy.

vmstat 1

System Configuration: lcpu=2 mem=5760MB

kthr memory page faults cpu
----- ----------- ------------------------ ------------ -----------
r b avm fre re pi po fr sr cy in sy cs us sy id wa
6 2 1732659 2042 0 177 110 516 1434 0 979 11802 2073 95 5 0 0
5 1 1732630 1684 0 367 0 0 0 0 968 10056 2122 97 3 0 0
4 2 1731586 1155 0 351 0 0 0 0 972 1763 1945 95 3 0 1
2 5 1731585 940 0 7 858 3575 9460 0 781 935 1561 89 8 0 3
1 4 1732569 895 0 7 395 1773 3598 0 468 1509 644 24 6 0 70
3 3 1732456 2 0 6 407 8139 41689 0 1338 4883 2924 59 17 0 25
1 4 1732455 0 0 0 512 1024 1667 0 1415 320 4249 67 8 0 25
1 4 1732454 111 0 0 594 2432 3842 0 2615 380 8529 7 18 0 75
7 5 1732456 706 0 2 603 0 0 0 570 452 507 9 2 0 88

Thank You,

regards,
Herison

 

[khalidaaa]

What's the output of vmo -a?

I think you need to tune minfree and maxfree to allow better paging and to make sure that there are some empty slots for memory in the memory free list (fre column in vmstat)

you can refer to this link:

http://www.tek-tips.com/viewthread.cfm?qid=1302007&page=1

There are nice memory tuning comments given by mike, kHz and the rest.

as a rule of thumb if
(((%avm*4096)/RAM installed) * 100) + 5% of RAM > 100% (total RAM)
Then your memory is overcommited!

Buy more memory or tune the memory usage by the application!

The run queue is huge! looking at the vmstat you have 7 processes waiting in the run queue which is too much! you said you have one CPU but from the vmstat output it shows 2! Are you running smt? What kind of machine are you running this on? is it an LPAR?

If you are running on an LPAR with aix 5.3 then i guess you can use virtual CPUs to distribute the processes on them! you will have better CPU utilization by doing so! but you will need to increase the CPU power i think! You don't have the entited capacity on the vmstat output so i guess its not an LPAR!

Could you confirm the above please?

Regards,
Khalid

 

[mrn]

more cpu, more memory or try

http://www.sarcheck.com

for tunning.

Mike

"Whenever I dwell for any length of time on my own shortcomings, they gradually begin to seem mild, harmless, rather engaging little things, not at all like the staring defects in other people's characters."