SCO 5.0.5 SLOOOOOOOOW

[ChicagoRick]

I am at my wits end. My SCO server is soo slow I am going to burn it. It is a great system but something is dogging it down. Here is my ps -ef. Any suggestions????

UID PID PPID C STIME TTY TIME CMD
root 0 0 0 08:28:45 ? 00:00:03 sched
root 1 0 0 08:28:45 ? 00:00:00 /etc/init -a
root 2 0 0 08:28:45 ? 00:00:00 vhand
root 3 0 0 08:28:45 ? 00:00:01 bdflush
root 4 0 0 08:28:45 ? 00:00:00 kmdaemon
root 5 1 0 08:28:45 ? 00:00:45 htepi_daemon /
root 6 0 0 08:28:45 ? 00:00:00 strd
root 740 1 0 08:32:56 tty01 00:00:00 /bin/login baduser
root 47 1 0 08:31:38 ? 00:00:00 /etc/ifor_pmd
root 48 47 0 08:31:38 ? 00:00:00 /etc/ifor_pmd
root 44 1 0 08:31:37 ? 00:00:01 /etc/syslogd
root 36 1 0 08:31:37 ? 00:00:00 htepi_daemon /stand
root 74 1 0 08:31:44 ? 00:00:00 strerr
root 52 48 0 08:31:38 ? 00:00:00 /etc/sco_cpd
root 3644 616 0 11:12:11 ? 00:00:07 vfsd --profile /usr/vision/vfsprofile
root 61 48 0 08:31:41 ? 00:00:00 /etc/ifor_sld
root 741 1 0 08:32:56 tty03 00:00:00 /etc/getty tty03 sc_m
root 742 1 0 08:32:56 tty04 00:00:00 /etc/getty tty04 sc_m
root 363 1 0 08:32:22 ? 00:00:00 /etc/snmpd
root 646 1 0 08:32:43 ? 00:00:00 /usr/internet/etc/ncsa_httpd -d /usr/internet/admin
root 276 1 0 08:32:21 ? 00:00:00 /etc/cron
root 261 1 0 08:32:21 ? 00:00:00 /opt/K/SCO/lli/5.0.5a/bin/dlpid /var/opt/K/SCO/lli/5.0.5a/dlpidPIPE
root 302 1 0 08:32:21 ? 00:00:00 portmap
root 201 1 0 08:32:20 ? 00:00:00 htepi_daemon /u
root 287 1 0 08:32:21 ? 00:00:06 /usr/lib/lpsched
husky1 823 810 0 08:40:03 ttyp4 00:00:00 -ksh
root 312 1 0 08:32:21 ? 00:00:00 rwalld
root 227 1 0 08:32:20 ? 00:00:00 /etc/digidl /dev/epcadl
domingo 4025 4023 0 12:01:07 ttyp11 00:00:00 -ksh
root 310 1 0 08:32:21 ? 00:00:00 rusersd
root 332 1 0 08:32:21 ? 00:00:00 /etc/inetd
root 743 1 0 08:32:56 tty05 00:00:00 /etc/getty tty05 sc_m
root 881 332 0 08:45:33 ? 00:00:00 telnetd
root 403 1 0 08:32:23 ? 00:00:00 lockd -u 4 -t 16
root 346 1 0 08:32:21 ? 00:00:00 routed
root 367 365 0 08:32:22 tty02 00:00:00 /usr/bin/X11/X :0 -crt /dev/tty02 -auth /usr/lib/X11/scologin/auth-server
root 365 1 0 08:32:22 ? 00:00:00 /usr/bin/X11/scologin
root 357 1 0 08:32:22 ? 00:00:00 /usr/lib/lpd
domingo 4036 4025 0 12:01:07 ttyp11 00:00:00 -ksh
root 371 365 0 08:32:22 ? 00:00:00 /usr/bin/X11/scologin
root 728 1 0 08:32:56 ? 00:00:00 tee -a /usr/adm/rc2.log
root 454 453 0 08:32:23 ? 00:00:00 /usr/internet/ns_httpd/admserv/ns-admin -d /usr/internet/ns_httpd/admserv
domingo 4046 4036 0 12:01:07 ttyp11 00:00:00 -ksh
root 395 1 0 08:32:23 ? 00:00:00 biod 4
root 396 1 0 08:32:23 ? 00:00:00 biod 4
root 397 1 0 08:32:23 ? 00:00:00 biod 4
root 398 1 0 08:32:23 ? 00:00:00 statd
root 400 1 0 08:32:23 ? 00:00:00 biod 4
root 456 454 0 08:32:23 ? 00:00:00 /usr/internet/ns_httpd/admserv/ns-admin -d /usr/internet/ns_httpd/admserv
root 444 367 0 08:32:23 tty02 00:00:00 vbiosd 8
root 418 415 0 08:32:23 ? 00:00:00 lockd -u 4 -t 16
root 419 415 0 08:32:23 ? 00:00:00 lockd -u 4 -t 16
root 415 403 0 08:32:23 ? 00:00:00 lockd -u 4 -t 16
root 420 415 0 08:32:23 ? 00:00:00 lockd -u 4 -t 16
root 421 415 0 08:32:23 ? 00:00:00 lockd -u 4 -t 16
root 453 1 0 08:32:23 ? 00:00:00 /usr/internet/ns_httpd/admserv/ns-admin -d /usr/internet/ns_httpd/admserv
root 731 1 0 08:32:56 ? 00:00:00 /etc/amirdmon
rolando 3723 3685 0 11:16:28 ttyp2 00:00:00 -ksh
root 611 1 0 08:32:43 ? 00:00:46 vfsd --profile /usr/vision/vfsprofile
rolando 3733 3723 0 11:16:28 ttyp2 00:00:00 -ksh
nouser 462 1 0 08:32:24 ? 00:00:00 ./ns-httpd -d /usr/internet/ns_httpd/httpd-80/config
root 610 1 0 08:32:42 ? 00:00:03 vfslockd 5 900 /usr/vision/vfsdata/logs
nouser 479 462 0 08:32:24 ? 00:00:00 ./ns-httpd -d /usr/internet/ns_httpd/httpd-80/config
root 616 611 0 08:32:43 ? 00:00:00 vfsd --profile /usr/vision/vfsprofile
rolando 3740 3733 0 11:16:28 ttyp2 00:00:00 /usr/lib/cobol/rts32 GRMS0000
nouser 649 646 0 08:32:43 ? 00:00:00 /usr/internet/etc/ncsa_httpd -d /usr/internet/admin
root 663 1 0 08:32:48 ? 00:00:00 /usr/lib/scosh/caldaemon
root 744 1 0 08:32:56 tty06 00:00:00 /etc/getty tty06 sc_m
root 745 1 0 08:32:56 tty07 00:00:00 /etc/getty tty07 sc_m
root 669 1 0 08:32:48 ? 00:00:00 /usr/lib/hpnp/hpnptyd -m /dev/ptyp99 -x 192.168.1.158 -k
root 647 1 0 08:32:43 ? 00:00:00 /var/scohttp/scohttpd -d /var/scohttp
root 675 1 0 08:32:48 ? 00:00:00 /usr/lib/hpnp/hpnptyd -m /dev/ptyp92 -x 192.168.1.30 -k
root 672 1 0 08:32:48 ? 00:00:00 /usr/lib/hpnp/hpnptyd -m /dev/ptyp90 -x 192.168.1.90 -k
root 678 1 0 08:32:48 ? 00:00:00 /usr/lib/hpnp/hpnptyd -m /dev/ptyp91 -x 192.168.1.31 -k
root 681 1 0 08:32:48 ? 00:00:00 /usr/lib/hpnp/hpnptyd -m /dev/ptyp93 -x 192.168.1.33 -k
root 684 1 0 08:32:48 ? 00:00:00 /usr/lib/hpnp/hpnptyd -m /dev/ptyp94 -x 192.168.1.34 -k
root 687 1 0 08:32:48 ? 00:00:00 /usr/lib/hpnp/hpnptyd -m /dev/ptyp95 -x 192.168.1.32 -k
root 690 1 0 08:32:48 ? 00:00:00 /usr/lib/hpnp/hpnptyd -m /dev/ptyp96 -x 192.168.1.35 -k
root 693 1 0 08:32:48 ? 00:00:00 /usr/lib/hpnp/hpnptyd -m /dev/ptyp97 -x 192.168.1.36 -k
root 696 1 0 08:32:48 ? 00:00:00 /usr/lib/hpnp/hpnptyd -m /dev/ptyp98 -x 192.168.1.37 -k
root 699 1 0 08:32:48 ? 00:00:00 /usr/lib/hpnp/hpnptyd -m /dev/ptyp89 -x 192.168.1.38 -k
root 783 332 0 08:36:45 ? 00:00:00 telnetd
root 746 1 0 08:32:56 tty08 00:00:00 /etc/getty tty08 sc_m
root 747 1 0 08:32:56 tty09 00:00:00 /etc/getty tty09 sc_m
root 748 1 0 08:32:56 tty10 00:00:00 /etc/getty tty10 sc_m
root 749 1 0 08:32:56 tty11 00:00:00 /etc/getty tty11 sc_m
root 750 1 0 08:32:56 tty12 00:00:00 /etc/getty tty12 sc_m
root 751 1 0 08:32:56 ? 00:00:00 /tcb/files/no_luid/sdd
root 752 1 0 08:32:56 tty2a 00:00:00 /etc/getty tty2a m
root 784 783 0 08:36:46 ttyp4 00:00:00 login -c -p
root 785 616 0 08:36:58 ? 00:00:04 vfsd --profile /usr/vision/vfsprofile
root 3681 332 0 11:15:16 ? 00:00:00 telnetd
root 3682 3681 0 11:15:16 ttyp2 00:00:00 login -c -p
rolando 3685 3682 0 11:15:26 ttyp2 00:00:01 -ksh
domingo 4053 4046 0 12:01:07 ttyp11 00:00:00 /usr/lib/cobol/rts32 GRMS0000
root 3962 332 0 11:58:17 ? 00:00:00 telnetd
husky1 810 784 0 08:39:23 ttyp4 00:00:01 -ksh
husky1 832 823 0 08:40:03 ttyp4 00:00:00 -ksh
husky1 836 832 0 08:40:04 ttyp4 00:00:01 /usr/lib/cobol/rts32 /u/grms/object/ut/ENVRUN
root 882 881 0 08:45:34 ttyp0 00:00:01 login -c -p
root 4054 3991 2 12:01:13 ttyp7 00:00:01 ps -ef
husky4 883 882 0 08:46:39 ttyp0 00:00:00 -ksh
husky4 889 883 0 08:46:40 ttyp0 00:00:00 -ksh
husky4 898 889 0 08:46:40 ttyp0 00:00:00 -ksh
husky4 902 898 0 08:46:40 ttyp0 00:00:04 /usr/lib/cobol/rts32 /u/grms/object/ut/ENVRUN
root 907 616 0 08:49:33 ? 00:00:01 vfsd --profile /usr/vision/vfsprofile
root 908 332 0 08:50:28 ? 00:00:00 telnetd
root 909 908 0 08:50:28 ttyp5 00:00:00 login -c -p
root 3990 3962 0 11:58:33 ttyp7 00:00:01 login -c -p
root 911 909 0 08:50:33 ttyp5 00:00:02 -ksh
root 917 911 0 08:51:15 ttyp5 00:00:00 -ksh
root 927 917 0 08:51:16 ttyp5 00:00:00 -ksh
root 934 927 0 08:51:16 ttyp5 00:00:04 /usr/lib/cobol/rts32 GRMS0000
root 1040 332 0 08:59:00 ? 00:00:00 telnetd
root 1041 1040 0 08:59:00 ttyp6 00:00:00 login -c -p
rolando 2962 2929 0 10:56:26 ttyp16 00:00:00 -ksh
root 2785 616 0 10:53:02 ? 00:00:00 vfsd --profile /usr/vision/vfsprofile
root 3991 3990 0 11:58:57 ttyp7 00:00:03 ksh
root 4022 332 0 12:00:46 ? 00:00:00 telnetd
root 961 616 0 08:52:37 ? 00:00:00 vfsd --profile /usr/vision/vfsprofile
root 4023 4022 0 12:00:47 ttyp11 00:00:00 login -c -p
roro 4024 616 0 12:01:01 ? 00:00:00 vfsd --profile /usr/vision/vfsprofile
emilio 1141 1135 0 09:20:30 ttyp8 00:00:00 -ksh
root 1073 1 0 09:04:31 ? 00:00:00 ./usqlsd port=7000
emilio 1152 1141 0 09:20:32 ttyp8 00:00:00 -ksh
root 1134 332 0 09:19:07 ? 00:00:00 telnetd
root 1135 1134 0 09:19:07 ttyp8 00:00:01 login -c -p
root 1172 332 0 09:25:53 ? 00:00:00 telnetd
emilio 1162 1152 0 09:20:32 ttyp8 00:00:00 -ksh
emilio 1169 1162 0 09:20:32 ttyp8 00:00:06 /usr/lib/cobol/rts32 GRMS0000
root 1173 1172 0 09:25:53 ttyp9 00:00:00 login -c -p
max 1174 1173 0 09:25:56 ttyp9 00:00:01 -ksh
max 1185 1174 0 09:26:58 ttyp9 00:00:00 -ksh
max 1195 1185 0 09:26:58 ttyp9 00:00:00 -ksh
max 1202 1195 0 09:26:58 ttyp9 00:00:00 /usr/lib/cobol/rts32 GRMS0000
root 1222 332 0 09:37:12 ? 00:00:00 telnetd
root 1223 1222 0 09:37:13 ttyp10 00:00:00 login -c -p
dock1 1224 1223 0 09:37:18 ttyp10 00:00:02 -ksh
dock1 1230 1224 0 09:38:01 ttyp10 00:00:00 -ksh
dock1 1239 1230 0 09:38:01 ttyp10 00:00:00 -ksh
dock1 1243 1239 0 09:38:02 ttyp10 00:00:01 /usr/lib/cobol/rts32 /u/grms/object/ut/ENVRUN
root 1511 332 0 10:12:40 ? 00:00:00 telnetd
root 1512 1511 0 10:12:41 ttyp12 00:00:01 login -c -p
root 1513 1512 0 10:13:35 ttyp12 00:00:01 ksh
root 1524 1513 0 10:15:34 ttyp12 00:00:00 ksh
marylou 1417 616 0 10:02:38 ? 00:00:00 vfsd --profile /usr/vision/vfsprofile
root 1534 1524 0 10:15:34 ttyp12 00:00:00 ksh
root 1371 1359 0 10:01:50 ttyp13 00:00:00 ksh
root 1357 332 0 10:01:06 ? 00:00:00 telnetd
root 1358 1357 0 10:01:06 ttyp13 00:00:01 login -c -p
root 1359 1358 0 10:01:46 ttyp13 00:00:01 ksh
root 1541 1534 0 10:15:34 ttyp12 00:00:00 /usr/lib/cobol/rts32 GRMS0000
root 1382 1371 0 10:01:51 ttyp13 00:00:00 ksh
root 1398 1382 0 10:01:51 ttyp13 00:00:02 /usr/lib/cobol/rts32 GRMS0000
root 1626 332 0 10:24:26 ? 00:00:00 telnetd
root 1627 1626 0 10:24:27 ttyp14 00:00:00 login -c -p
truck1 1628 1627 0 10:24:59 ttyp14 00:00:01 -ksh
root 2175 332 0 10:40:50 ? 00:00:00 telnetd
root 2176 2175 0 10:40:51 ttyp1 00:00:00 login -c -p
root 2195 2176 0 10:40:59 ttyp1 00:00:00 -ksh
root 2220 2195 0 10:41:40 ttyp1 00:00:00 -ksh
truck1 1668 1628 0 10:25:40 ttyp14 00:00:00 -ksh
truck1 1681 1668 0 10:25:41 ttyp14 00:00:00 -ksh
truck1 1685 1681 0 10:25:41 ttyp14 00:00:01 /usr/lib/cobol/rts32 /u/grms/object/ut/ENVRUN
rolando 2995 2962 0 10:56:27 ttyp16 00:00:00 -ksh
rolando 3005 2995 0 10:56:27 ttyp16 00:00:00 -ksh
root 2230 2220 0 10:41:40 ttyp1 00:00:00 -ksh
root 2237 2230 0 10:41:40 ttyp1 00:00:06 /usr/lib/cobol/rts32 GRMS0000
rolando 3012 3005 0 10:56:27 ttyp16 00:00:06 /usr/lib/cobol/rts32 GRMS0000
root 2928 332 0 10:54:54 ? 00:00:00 telnetd
root 2929 2928 0 10:54:54 ttyp16 00:00:01 login -c -p

 

[motoslide]

Is there anything of importance in /usr/adm/syslog or /usr/adm/messages?
None of your current processes appears to be eating up CPU time.
Is it slow to produce a login prompt? Slow working through your application? Have you tried any of the "sar" commands?
(i.e.)
# sar -u 2 5
# sar -q 2 5

Is that the complete "ps" list?

"Proof that there is intelligent life in Oregon. Well, Life anyway.

 

[Annihilannic]

Quantify slow... are response times in the application slow? What kind of application is it running? Are network connections slow too, e.g. an FTP transfer? How about running normal commands like uptime and ls from the shell prompt? What's the output of vmstat 5 5 and sar -A 5 5? Is it just as slow when you are running commands on the console (i.e. standing in front of the server itself)? Is it slow all the time, or does it just slow down occasionally?

Annihilannic.

 

[ChicagoRick]

Slow login prompt, slow password prompt (10 seconds), after passwd, 15 - 20 seconds before I see a $ sign. 30 users. Automotive MRP system (Genzlinger). Console ust as slow.
SCO_SV tflexu 3.2v5.0.5 i80386 08/08/2008

06:48:28 %usr %sys %wio %idle (-u)
06:48:30 0 6 27 67
06:48:32 0 0 0 100
06:48:34 0 0 0 100
06:48:36 0 0 0 100
06:48:38 0 0 0 100

Average 0 1 5 93


SCO_SV tflexu 3.2v5.0.5 i80386 08/08/2008

06:51:06 runq-sz %runocc swpq-sz %swpocc (-q)
06:51:08
06:51:10
06:51:12
06:51:14
06:51:16

Average

PROCS PAGING SYSTEM CPU
r b w frs dmd sw cch fil pft frp pos pif pis rso rsi sy cs us su id

0 108 0 600000 0 0 0 0 0 0 0 0 0 0 0 54 13 0 0 100

0 108 0 600000 0 0 0 0 0 0 0 0 0 0 0 93 15 0 0 100

0 108 0 600000 0 0 0 0 0 0 0 0 0 0 0 60 13 0 0 100

0 108 0 600000 0 0 0 0 0 0 0 0 0 0 0 65 16 0 0 100

0 108 0 600000 0 0 0 0 0 0 0 0 0 0 0 53 12 0 0 100



SCO_SV tflexu 3.2v5.0.5 i80386 08/08/2008

06:53:20 %usr %sys %wio %idle (-u)
bread/s lread/s %rcache bwrit/s lwrit/s %wcache pread/s pwrit/s (-b)
device %busy avque r+w/s blks/s avwait avserv (-d)
c_hits cmisses (hit %) (-n)
rawch/s canch/s outch/s rcvin/s xmtin/s mdmin/s (-y)
scall/s sread/s swrit/s fork/s exec/s rchar/s wchar/s (-c)
swpin/s bswin/s swpot/s bswot/s pswch/s (-w)
iget/s namei/s dirbk/s (-a)
runq-sz %runocc swpq-sz %swpocc (-q)
proc-sz ov inod-sz ov file-sz ov lock-sz (-v)
msg/s sema/s (-m)
vflt/s pflt/s pgfil/s rclm/s (-p)
freemem freeswp availrmem availsmem (-r)
cpybuf/s slpcpybuf/s (-B)
dptch/s idler/s swidle/s (-R)
ovsiohw/s ovsiodma/s ovclist/s (-g)
mpbuf/s ompb/s mphbuf/s omphbuf/s pbuf/s spbuf/s dmabuf/s sdmabuf/s (-h)

06:53:25 0 0 0 100
-1 -3 80 0 0 100 0 0

32 0 (100%)
0 0 0 0 0 0
69 14 5 0.00 0.00 49800 966
0.00 0.0 0.00 0.0 14
6 2 0

116/ 214 0 446/2867 0 425/1024 0 23/ 128
0.00 0.00
11.18 1.80 0.00 0.00
959565 600000 970202 1033192
0.00 0.00
128.94 106.99 5.99
0.00 0.00 0.00
0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00

06:53:30 0 1 0 99
-0 2728 100 2 12 81 0 0

398 7 (98%)
1 0 94 0 0 0
249 38 11 0.00 0.00 58521 1471
0.00 0.0 0.00 0.0 17
81 42 2422

116/ 214 0 447/2867 0 439/1024 0 30/ 128
0.00 0.00
2.59 0.20 0.00 0.00
959557 600000 970202 1033189
0.00 0.00
129.74 105.99 6.59
0.00 0.00 0.00
0.00 0.00 0.20 0.00 0.00 0.00 0.00 0.00

06:53:35 0 1 0 99
-0 175 100 18 7 0 0 0
Sdsk-0 1.20 1.00 14.17 35.13 0.00 0.85

32 0 (100%)
0 0 0 0 0 0
62 13 5 0.00 0.00 49797 1170
0.00 0.0 0.00 0.0 18
6 2 0

116/ 214 0 446/2867 0 439/1024 0 30/ 128
0.00 0.00
0.00 0.00 0.00 0.00
959552 600000 970202 1033189
0.00 0.00
134.73 109.18 8.98
0.00 0.00 0.00
0.00 0.00 11.18 0.00 0.00 0.00 0.00 0.00

06:53:40 0 0 0 100
-0 -3 85 1 1 33 0 0

22 0 (100%)
0 0 0 0 0 0
79 13 4 0.00 0.00 49805 958
0.00 0.0 0.00 0.0 19
4 1 0

116/ 214 0 446/2867 0 439/1024 0 30/ 128
0.00 0.00
0.00 0.00 0.00 0.00
959552 600000 970202 1033189
0.00 0.00
136.53 108.18 8.98
0.00 0.00 0.00
0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00

06:53:45 0 0 0 100
-0 -2 91 0 0 100 0 0

32 0 (100%)
0 0 0 0 0 0
65 13 5 0.00 0.00 49797 967
0.00 0.0 0.00 0.0 14
6 2 0

116/ 214 0 446/2867 0 439/1024 0 30/ 128
0.00 0.00
0.00 0.00 0.00 0.00
959552 600000 970202 1033189
0.00 0.00
126.95 106.19 5.79
0.00 0.00 0.00
0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00


Average 0 0 0 99
Average 171455780 85727924 100 4 4 1 0 0
Average Sdsk-0 0.24 1.00 2.83 7.03 0.00 0.85
Average 103 1 (98%)
Average 0 0 19 0 0 0
Average 105 18 6 0.00 0.00 51544 1107
Average 0.00 0.0 0.00 0.0 16
Average 21 10 484
Average
Average 0.00 0.00
Average 2.75 0.40 0.00 0.00
Average 959556 600000 970202 1033190
Average 0.00 0.00
Average 131.38 107.31 7.27
Average 0.00 0.00 0.00
Average 0.00 0.00 2.28 0.00 0.00 0.00 0.00 0.00


I am dogging at all times. The only "new" thing that is happening is I added 10 scanners for production. I have spoken with other people that use this same software and they have not seen this issue.

Network connections are slow for the most part but I figured that to be normal with the amount of pcs and the amount of data transfers we are doing over the network.

ls and uptime stalls for a few seconds.

 

[M577A2]

What does this command return:

ps -A -o pcpu -o pid -o comm | sort -r | more

 

[ChicagoRick]

This is what I got. Thanks!

70.05 7848 vfsd
9.22 8246 rts32
8.45 731 amirdmon
5.27 611 vfsd
2.63 371 scologin
2.19 9066 ksh
0.89 5 htepi_daemon
0.49 8870 rts32
0.12 9063 usqlsd
0.08 9064 telnetd
0.04 9065 login
0.00 9079 more
0.00 9078 sort
0.00 9077 ps
0.00 9062 showfile
0.00 9061 sh
0.00 9060 sfehelpr
0.00 9059 sh
0.00 8863 ksh
0.00 8853 ksh
0.00 8836 ksh
0.00 8835 login
0.00 8834 telnetd
0.00 8242 ksh

 

[M577A2]

SCO VisionFS is kicking your server's tail... Does it always use this much CPU? Have you rebooted the server recently?

 

[ChicagoRick]

I have been rebooting weekly for a while now.


I stopped VFS and It is still slow at the login - passwd and getting to a $..

50.34 9581 login
7.57 5 htepi_daemon
7.41 9579 telnetd
3.74 371 scologin
3.50 731 amirdmon
2.46 9128 ksh
1.52 9580 login
0.84 663 caldaemon
0.61 7819 rts32
0.58 1 init
0.17 44 syslogd
0.16 287 lpsched
0.06 7873 rts32
0.00 9582 ps
0.00 9127 login
0.00 9126 telnetd
0.00 9063 usqlsd
0.00 8870 rts32
0.00 8863 ksh
0.00 8853 ksh
0.00 8836 ksh
0.00 8835 login
0.00 8834 telnetd
0.00 8246 rts32


This is my startup file in rc2.d:

"S90visionfs" 67 lines, 1303 characters
else
echo "$0: cannot find $c_exefile" 1>&2
exit 1
fi
;;
start)
if [ -x $c_exefile ]; then
$c_exefile start --rcstart
else
echo "$0: cannot find $c_exefile" 1>&2
exit 1
fi
;;
start_msg)
echo "Starting SCO VisionFS"
;;
stop_msg)
echo "Stopping SCO VisionFS"
;;
*)
echo "$0: Usage {start|stop|start_msg|stop_msg}" 1>&2
exit 1
esac
:q!

else
echo "$0: cannot find $c_exefile" 1>&2
exit 1
fi
;;
start)
if [ -x $c_exefile ]; then
$c_exefile start --rcstart
else
echo "$0: cannot find $c_exefile" 1>&2
exit 1
fi
;;
start_msg)
echo "Starting SCO VisionFS"
;;
stop_msg)
echo "Stopping SCO VisionFS"
;;
*)
echo "$0: Usage {start|stop|start_msg|stop_msg}" 1>&2
exit 1
esac
:q!
_/etc/rc2.d> more S90visionfs
#!/bin/sh

# Start/stop VisionFS

# This file runs the default installation of visionfs
# This file will be replaced when setup is run
# If you want to make changes to this file, move it to a new
# filename first.

# be paranoid about the current path
if [ -d /bin ]; then
PATH=/bin:$PATH
fi
if [ -d /sbin ]; then
PATH=/sbin:$PATH
fi
if [ -d /usr/bin ]; then
PATH=/usr/bin:$PATH
fi
if [ -d /usr/sbin ]; then
PATH=/usr/sbin:$PATH
fi
if [ -d /etc ]; then
PATH=/etc:$PATH
fi
export PATH

# This script was built from shell library
# $Id: install.shlib,v 10.19 1997/03/11 14:59:41 duncans Exp $

GLOB_VISION_FILE=/etc/vision.conf
VISION_FILE=/etc/vision.conf

if [ -f $GLOB_VISION_FILE ]; then
c_exefile=`grep "^VISION_BINDIR=" $GLOB_VISION_FILE | tail -1 | sed -e "
/^VISION_BINDIR=/s///"`
else
c_exefile=""
fi

c_exefile=$c_exefile/visionfs
case "$1" in
stop)
if [ -x $c_exefile ]; then
$c_exefile stop --quiet
else
echo "$0: cannot find $c_exefile" 1>&2
exit 1
fi
;;
start)
if [ -x $c_exefile ]; then
$c_exefile start --rcstart
else
echo "$0: cannot find $c_exefile" 1>&2
exit 1
fi
;;
start_msg)
echo "Starting SCO VisionFS"
;;
stop_msg)
echo "Stopping SCO VisionFS"
;;
*)
echo "$0: Usage {start|stop|start_msg|stop_msg}" 1>&2
exit 1
esac

 

[motoslide]

I've seen where the hpnptypd background processes cause headaches. Are these associated with the scanners? Can you temporarily kill those processes to see if system performance changes? Do the scanners use VisionFS shares as a means to save the images? Can you temporarily stop VisionFS as a troubleshooting step?

How about these commands:
# netstat -m
# netstat -an

Also, there is a known performance hit with the "amirdmon" process. You can try killing that, but be aware that the O/S would no longer report a disk failure in your RAID subsystem.



"Proof that there is intelligent life in Oregon. Well, Life anyway.

 

[ChicagoRick]

I did stop VisionFS and that helped a little.

The hpnptypd is associated with my scanners but I cannot stop those right now. The scanners have nothing to do with VisionFS.


It is still slow at the login - passwd and getting to a $..


netstat -m:
streams allocation:
config alloc free total max fail
stream 4096 143 3953 5826 192 0
queues 794 293 501 11898 393 0
mblks 1124 235 889 3616744 1041 0
buffer headers 1466 1283 183 106206 1360 0
class 1, 64 bytes 640 30 610 1393364 632 0
class 2, 128 bytes 128 0 128 687880 104 0
class 3, 256 bytes 144 15 129 410630 140 0
class 4, 512 bytes 32 6 26 6895 28 0
class 5, 1024 bytes 36 0 36 6568 33 0
class 6, 2048 bytes 168 70 98 627604 167 0
class 7, 4096 bytes 25 17 8 397 25 0
class 8, 8192 bytes 7 0 7 235 7 0
class 9, 16384 bytes 3 0 3 237 3 0
class 10, 32768 bytes 3 0 3 188 3 0
class 11, 65536 bytes 2 0 2 608 2 0
class 12, 131072 bytes 0 0 0 0 0 0
class 13, 262144 bytes 0 0 0 0 0 0
class 14, 524288 bytes 0 0 0 0 0 0
total configured streams memory: 2000.00KB
streams memory in use: 270.04KB
maximum streams memory used: 979.53KB


-an:
Active Internet connections (including servers)
Proto Recv-Q Send-Q Local Address Foreign Address (state)
tcp 0 0 192.168.1.60.4360 192.168.1.90.9100 ESTABLISHED
tcp 0 4 192.168.1.60.23 66.178.192.98.55119 ESTABLISHED
tcp 0 0 192.168.1.60.4356 192.168.1.36.9100 SYN_SENT
tcp 0 0 192.168.1.60.4355 192.168.1.158.9100 SYN_SENT
tcp 0 0 192.168.1.60.23 192.168.1.227.1815 ESTABLISHED
tcp 0 0 192.168.1.60.7000 192.168.1.53.3150 ESTABLISHED
tcp 0 0 192.168.1.60.23 192.168.1.182.1245 ESTABLISHED
tcp 0 0 192.168.1.60.23 192.168.1.61.1135 ESTABLISHED
tcp 0 0 192.168.1.60.4138 192.168.1.37.9100 ESTABLISHED
tcp 0 0 192.168.1.60.4136 192.168.1.35.9100 ESTABLISHED
tcp 0 0 192.168.1.60.4132 192.168.1.30.9100 ESTABLISHED
tcp 0 0 192.168.1.60.23 192.168.1.225.1492 ESTABLISHED
tcp 0 0 192.168.1.60.23 192.168.1.43.1043 ESTABLISHED
tcp 0 0 192.168.1.60.23 192.168.1.40.1044 ESTABLISHED
tcp 0 0 192.168.1.60.4108 192.168.1.34.9100 ESTABLISHED
tcp 0 0 192.168.1.60.23 192.168.1.44.1042 ESTABLISHED
tcp 0 0 192.168.1.60.4096 192.168.1.33.9100 ESTABLISHED
tcp 0 0 192.168.1.60.4092 192.168.1.31.9100 ESTABLISHED
tcp 0 0 192.168.1.60.23 192.168.1.53.1524 ESTABLISHED
tcp 0 0 192.168.1.60.3730 192.168.1.32.9100 ESTABLISHED
tcp 0 0 *.7000 *.* LISTEN
tcp 0 0 192.168.1.60.1044 192.168.1.38.9100 ESTABLISHED
tcp 0 0 *.615 *.* LISTEN
tcp 0 0 *.457 *.* LISTEN
tcp 0 0 *.620 *.* LISTEN
tcp 0 0 *.* *.* CLOSED
tcp 0 0 *.1015 *.* LISTEN
tcp 0 0 *.1027 *.* LISTEN
tcp 0 0 *.1026 *.* LISTEN
tcp 0 0 *.6000 *.* LISTEN
tcp 0 0 *.199 *.* LISTEN
tcp 0 0 *.515 *.* LISTEN
tcp 0 0 *.901 *.* LISTEN
tcp 0 0 *.143 *.* LISTEN
tcp 0 0 *.110 *.* LISTEN
tcp 0 0 *.37 *.* LISTEN
tcp 0 0 *.13 *.* LISTEN
tcp 0 0 *.19 *.* LISTEN
tcp 0 0 *.9 *.* LISTEN
tcp 0 0 *.7 *.* LISTEN
tcp 0 0 *.1 *.* LISTEN
tcp 0 0 *.79 *.* LISTEN
tcp 0 0 *.512 *.* LISTEN
tcp 0 0 *.513 *.* LISTEN
tcp 0 0 *.514 *.* LISTEN
tcp 0 0 *.23 *.* LISTEN
tcp 0 0 *.21 *.* LISTEN
tcp 0 0 *.111 *.* LISTEN
udp 0 0 *.1015 *.*
udp 0 0 *.958 *.*
udp 0 0 *.957 *.*
udp 0 0 *.1031 *.*
udp 0 0 *.177 *.*
udp 0 0 *.1027 *.*
udp 0 0 *.161 *.*
udp 0 0 *.520 *.*
udp 0 0 *.37 *.*
udp 0 0 *.13 *.*
udp 0 0 *.19 *.*
udp 0 0 *.9 *.*
udp 0 0 *.7 *.*
udp 0 0 *.518 *.*
udp 0 0 *.512 *.*
udp 0 0 *.* *.*
udp 0 0 *.1026 *.*
udp 0 0 *.1025 *.*
udp 0 0 *.111 *.*
udp 0 0 *.1024 *.*
udp 0 0 *.488 *.*
udp 0 0 *.* *.*
udp 0 0 *.514 *.*
Active UNIX domain sockets
Address Type Recv-Q Send-Q Conn Addr
fce2dd60 stream 0 0 fce2e540
fce2e540 stream 0 0 fce2dd60
fce2cf50 stream 0 0 fce2afd0
fce2afd0 stream 0 0 fce2cf50
fce2cfe0 dgram 0 0 fce28828
fce2d100 stream 0 0 fce2d070
fce2d070 stream 0 0 fce2d100
fce2eb70 stream 0 0 fce2a400
fce2a400 stream 0 0 fce2eb70
fce2e780 stream 0 0 fce2e810
fce2e810 stream 0 0 fce2e780
fce2ef60 stream 0 0 fce2d4f0
fce2d4f0 stream 0 0 fce2ef60
fce2e738 stream 0 0 fce2d8e0
fce2d8e0 stream 0 0 fce2e738
fce2b2a0 stream 0 0 fce2e6a8
fce2e6a8 stream 0 0 fce2b2a0
fce2b450 stream 0 0 fce2b060
fce2b060 stream 0 0 fce2b450
fce2c1d0 dgram 0 0 fce28828
fce28168 stream 0 0 0 /usr/tmp/scohelp.sock
et
fce2b600 stream 0 0 fce2b690
fce2b690 stream 0 0 fce2b600
fce2b720 stream 0 0 fce2b7b0
fce2b7b0 stream 0 0 fce2b720
fce2b840 stream 0 0 fce2b8d0
fce2b8d0 stream 0 0 fce2b840
fce2a370 stream 0 0 fce2a2e0
fce2a2e0 stream 0 0 fce2a370
fce2a5b0 dgram 0 0 fce28828
fce2ac28 stream 0 0 0 /dev/printer
fce29ab8 dgram 0 0 fce28828
fce28318 stream 0 0 fce283a8
fce283a8 stream 0 0 fce28318
fce28438 stream 0 0 fce28558
fce284c8 stream 0 0 0 /pmd/PMDCT_pipe
fce28558 stream 0 0 fce28438
fce285e8 stream 0 0 0 /pmd/LST_pipe
fce28678 stream 0 0 0 /pmd/IPCCT_pipe
fce28798 dgram 0 0 fce28828
fce28828 dgram 0 0 0 /dev/syslog

 

[M577A2]

Do you see anything in /var/adm/syslog?

 

[ChicagoRick]

Here is the tail of the syslog:

Aug 8 08:31:38 tflexu sco_cpd: duplicate license #60, 2EH023720
Aug 8 08:31:38 tflexu sco_cpd: duplicate license #64, 2EH023720
Aug 8 08:31:38 tflexu sco_cpd: duplicate license #65, 2EH023720
Aug 8 08:31:38 tflexu sco_cpd: duplicate license #132, 2EH023720
Aug 8 08:31:38 tflexu sco_cpd: duplicate license #1, 2EH023720
Aug 8 08:31:38 tflexu sco_cpd: duplicate license #2, 2EH023720
Aug 8 09:03:37 tflexu telnetd[7844]: can't find user in protected password dat
abase
Aug 8 09:14:34 tflexu lpd: getq: opendir failed for /usr/spool/lpd/lp_savin - N
o such file or directory
Aug 8 09:15:24 tflexu lpd: getq: opendir failed for /usr/spool/lpd/lp_savin - N
o such file or directory
Aug 8 09:16:25 tflexu last message repeated 2 times

 

[ChicagoRick]

Here is the header of lpstat -t. I can't figure out how to get rid of the savin. It is not in the spooler....

lp_savin:
lpstat: couldn't stat spool directory for 'print'
unable to get hostname for remote machine savin
lpstat: lp_savin: cannot chdir to spooling directory
lpstat: lp_savin: cannot examine spooling area

Warning: no daemon present
Req-Id Owner Size Date
scheduler is running

 

[M577A2]

It looks like there's a duplicate SCO license on the network...

Recreate or remove the lp_savin remote print queue

We've treated any problems with SCO "databases" with

authck -av
cd /etc/auth/system
mv ttys /tmp/ttys.bad
touch /etc/auth/system/ttys
chown auth:auth /etc/auth/system/ttys
/tcb/bin/ttyupd
/tcb/bin/ale /etc/auth/system/ttys pttyupd

 

[M577A2]

Remove /var/spool/lpd/lp_savin if it exists.
Remove 2 entries for lp_savin from /etc/printcap.
/usr/lib/lpshut
ps -ef | grep lpd (and/or lp) and kill the processes
/usr/lib/lpd
/usr/lib/lpsched
lpstat -p (to make sure it's gone)

 

[ChicagoRick]

This is my only SCO server so it is not possible to have a dup.

 

[Annihilannic]

Did stopping amirdmon as motoslide suggested make any difference?

I can't see anything interesting in the sar output, but what does need investigation in my opinion is the number of "blocked" processes reported by vmstat. Not sure what to recommend though to find this out!

Also, what is the history here? Is this a server that has previously been stable for many moons without any issues? How old is the hardware? Is it multiprocessor, and if so do you have the multiprocessor licences installed or not?

Annihilannic.

 

[motoslide]

The "Duplicate license" message is puzzling here. But, if it is only logged a couple of times per day, I wouldn't think it would cause the continuous slowdown.
My best guess is with the hpnptyd processes and a network issue. What is your network card/driver?

# hwconfig -h

You've got some free disk space, right?



"Proof that there is intelligent life in Oregon. Well, Life anyway.

 

[ChicagoRick]

hwconfig -h

device address vec dma comment
====== ======= === === =======
kernel - - - rel=3.2v5.0.5 kid=98/07/02
cpu - - - unit=1 family=15
cpuid - - - unit=1 vend=GenuineIntel tfms=0:15:2:5
fpu - 13 - unit=1 type=80387-compatible
pci 0xcf8-0xcff - - am=1 sc=0 buses=14
PnP - - - nodes=0
serial 0x3f8-0x3ff 4 - unit=0 type=Standard nports=1 fifo=yes
serial 0x2f8-0x2ff 3 - unit=1 type=Standard nports=1 fifo=yes
console - - - unit=vga type=0 12 screens=68k
floppy 0x3f2-0x3f7 6 2 unit=0 type=135ds18
kbmouse 0x60-0x64 12 - type=Keyboard mouse
parallel 0x378-0x37a 7 - unit=0
adapter 0x1f0-0x1f7 14 - type=IDE ctlr=primary dvr=wd
adapter 0xcc00-0xccff 11 - type=blad ha=0 bus=0 id=7 fts=sto
adapter - 5 - type=amird ha=0 id=7
eeG0 0xece0-0xecff 5 - type=PRO/1000 00:11:43:5b:01:f4
cd-rom - - - type=IDE ctlr=pri cfg=mst dvr=Srom->wd
tape - - - type=S ha=0 id=2 lun=0 bus=0 ht=blad
disk - - - type=S ha=0 id=0 lun=0 bus=2 ht=amird
Sdsk - - - cyls=35669 hds=255 secs=63 fts=sdb
Stp-0 - - - Vendor=TANDBERG Product=SLR100

SPACE AVAILABLE

/ : Disk space: 120348.87 MB of 181792.15 MB available (66.20%).
/stand : Disk space: 24.30 MB of 39.06 MB available (62.23%).
/u : Disk space: 89926.53 MB of 97656.24 MB available (92.08%).

My MRP runs in /.

 

[stanhubble]

how many files are in the / directory?
if there are too many files in the root directory it would
make the system slow at retrieving/reading any file

and what is in /etc/resolv.conf?
if your network connections are not resolvable, the system can spend a lot of time trying to resolve names from ip addresses.