Having a ping and telnet problem long wait time.

[lblauen]

We have a p670 with several lpars. Running aix 5.1 and nis. When I nslookup a system name it comes right back with the correct information no delay. But when I ping or telnet to a system it takes almost a minute before it does anything. I checked the resolv.conf and got nslookup to work right but nothing else. I have tried the ip address and system name but both give long pauses before doing anything. I'm sure it's a resolv problem but I don't know what other files to check. Its a gigabit ethernet card. I did check to make sure we only had 1 default route. Its also not set to auto_negotiation. I also did a entstat to make sure there where no collisions. Any ideas what else to check?

 

[we2aresame]

since you have tried ip address and got the same error, it wasn't related to resolve. Try:
1. traceroute ip_address to make sure it goes to the right route.
2. make sure your network compatible with your adpater card setting
3. very basic but very important, check the ptf of AIX, Gigabit ethernet on AIX5.1/5.2 has some bugs, you may need
AIX 5.1: IY54323 AIX 5.2: IY54068

 

[unixfreak]

The hosts at the other end can't resolve your IP address.

Either:

1. Create a PTR zone on your DNS
or
2. Put the other hosts in your hosts file

Cheers

 

[lblauen]

traceroute goes to the right system.
card is set right.
host files are the same on all the lpars.
It's like ping and telnet are sleeping for a while before the start anything. I type ping and watch topas and nothing happens for almost a minute then it shows up and it starts to work.
Any more Ideas???

 

[raztaboule]

as w2aresam said you should check that the switch or whatever your aix is connected to is well configured.
for example you can have troubles if you are not in auto-negociation and the switch is in auto-negociation.
i don't know much about gigabit but don't you have to modify somes no parameters to make gigabit works right ?

 

[lblauen]

turns out its not the gigabit cards having the problem its the regular cards. Also when you type telnet or ftp and nothing else it take almost a minute for the apps to start. So I'm thinking its not the network but something in the start up of the programs telnet, ftp and ping. Im still at a loss to figure out why they take so long to start. Once they start they work fine.

 

[raztaboule]

can you post result of
no -a
and
netstat -v
and
lsattr -El <ent0>
and perhaps
lsof -p <pid of the process trying to telnet> while the process "hangs"

Bye.

 

[lblauen]

root@b4 :/ > no -a
arpqsize = 12
arpt_killc = 20
arptab_bsiz = 7
arptab_nb = 73
bcastping = 0
clean_partial_conns = 0
delayack = 0
delayackports = {}
dgd_packets_lost = 3
dgd_ping_time = 5
dgd_retry_time = 5
directed_broadcast = 0
extendednetstats = 0
fasttimo = 200
icmp6_errmsg_rate = 10
icmpaddressmask = 0
ie5_old_multicast_mapping = 0
ifsize = 256
inet_stack_size = 16
ip6_defttl = 64
ip6_prune = 1
ip6forwarding = 0
ip6srcrouteforward = 1
ipforwarding = 0
ipfragttl = 60
ipignoreredirects = 0
ipqmaxlen = 100
ipsendredirects = 1
ipsrcrouteforward = 1
ipsrcrouterecv = 0
ipsrcroutesend = 1
llsleep_timeout = 3
lowthresh = 90
main_if6 = 0
main_site6 = 0
maxnip6q = 20
maxttl = 255
medthresh = 95
multi_homed = 1
nbc_limit = 786432
nbc_max_cache = 131072
nbc_min_cache = 1
nbc_ofile_hashsz = 12841
nbc_pseg = 0
nbc_pseg_limit = 3145728
ndp_mmaxtries = 3
ndp_umaxtries = 3
ndpqsize = 50
ndpt_down = 3
ndpt_keep = 120
ndpt_probe = 5
ndpt_reachable = 30
ndpt_retrans = 1
net_malloc_police = 0
nonlocsrcroute = 0
nstrpush = 8
passive_dgd = 0
pmtu_default_age = 10
pmtu_rediscover_interval = 30
psebufcalls = 20
psecache = 1
pseintrstack = 12288
psetimers = 20
rfc1122addrchk = 0
rfc1323 = 0
rfc2414 = 0
route_expire = 1
routerevalidate = 0
rto_high = 64
rto_length = 13
rto_limit = 7
rto_low = 1
sack = 0
sb_max = 1048576
send_file_duration = 300
site6_index = 0
sockthresh = 85
sodebug = 0
somaxconn = 1024
strctlsz = 1024
strmsgsz = 0
strthresh = 85
strturncnt = 15
subnetsarelocal = 1
tcp_bad_port_limit = 0
tcp_ecn = 0
tcp_ephemeral_high = 65535
tcp_ephemeral_low = 32768
tcp_finwait2 = 1200
tcp_init_window = 0
tcp_inpcb_hashtab_siz = 24499
tcp_keepcnt = 8
tcp_keepidle = 14400
tcp_keepinit = 150
tcp_keepintvl = 150
tcp_limited_transmit = 1
tcp_maxburst = 0
tcp_mssdflt = 512
tcp_nagle_limit = 65535
tcp_ndebug = 100
tcp_newreno = 1
tcp_nodelayack = 0
tcp_pmtu_discover = 1
tcp_recvspace = 16384
tcp_sendspace = 16384
tcp_timewait = 1
tcp_ttl = 60
thewall = 1048576
udp_bad_port_limit = 0
udp_ephemeral_high = 65535
udp_ephemeral_low = 32768
udp_inpcb_hashtab_siz = 24499
udp_pmtu_discover = 1
udp_recvspace = 42080
udp_sendspace = 9216
udp_ttl = 30
udpcksum = 1
use_isno = 1

root@b4 :/ > netstat -v | pg
-------------------------------------------------------------
ETHERNET STATISTICS (ent0) :
Device Type: Gigabit Ethernet-SX PCI-X Adapter (14106802)
Hardware Address: 00:02:55:33:19:84
Elapsed Time: 0 days 17 hours 24 minutes 6 seconds

Transmit Statistics: Receive Statistics:
-------------------- -------------------
Packets: 76384 Packets: 70909
Bytes: 47519294 Bytes: 45830561
Interrupts: 0 Interrupts: 56754
Transmit Errors: 0 Receive Errors: 0
Packets Dropped: 0 Packets Dropped: 0
Bad Packets: 0
Max Packets on S/W Transmit Queue: 41
S/W Transmit Queue Overflow: 0
Current S/W+H/W Transmit Queue Length: 0

Broadcast Packets: 97 Broadcast Packets: 32618
Multicast Packets: 1 Multicast Packets: 6264
No Carrier Sense: 0 CRC Errors: 0
DMA Underrun: 0 DMA Overrun: 0
Lost CTS Errors: 0 Alignment Errors: 0
Max Collision Errors: 0 No Resource Errors: 0
Late Collision Errors: 0 Receive Collision Errors: 0
Deferred: 0 Packet Too Short Errors: 0
SQE Test: 0 Packet Too Long Errors: 0
Timeout Errors: 0 Packets Discarded by Adapter: 0
Single Collision Count: 0 Receiver Start Count: 0
Multiple Collision Count: 0
Current HW Transmit Queue Length: 0

General Statistics:
-------------------
No mbuf Errors: 0
Adapter Reset Count: 0
Adapter Data Rate: 2000
Driver Flags: Up Broadcast Running
Simplex 64BitSupport ChecksumOffload
PrivateSegment DataRateSet

Gigabit Ethernet-SX PCI-X Adapter (14106802) Specific Statistics:
--------------------------------------------------------------------
Link Status: Up
Media Speed Selected: Auto negotiation
Media Speed Running: 1000 Mbps Full Duplex
PCI Mode: PCI-X (100-133)
PCI Bus Width: 64-bit
Jumbo Frames: Disabled
TCP Segmentation Offload: Enabled
TCP Segmentation Offload Packets Transmitted: 1145
TCP Segmentation Offload Packet Errors: 0
Transmit and Receive Flow Control Status: Enabled
XON Flow Control Packets Transmitted: 0
XON Flow Control Packets Received: 0
XOFF Flow Control Packets Transmitted: 0
XOFF Flow Control Packets Received: 0
Transmit and Receive Flow Control Threshold (High): 32768
Transmit and Receive Flow Control Threshold (Low): 24576
Transmit and Receive Storage Allocation (TX/RX): 16/48
-------------------------------------------------------------
ETHERNET STATISTICS (ent1) :
Device Type: IBM 4-Port 10/100 Base-TX Ethernet PCI Adapter (23100020)
Hardware Address: 00:09:6b:4e:86:20
Elapsed Time: 0 days 17 hours 24 minutes 6 seconds

Transmit Statistics: Receive Statistics:
-------------------- -------------------
Packets: 20710 Packets: 61032
Bytes: 3290245 Bytes: 18486994
Interrupts: 16 Interrupts: 58611
Transmit Errors: 0 Receive Errors: 0
Packets Dropped: 1 Packets Dropped: 0
Bad Packets: 0
Max Packets on S/W Transmit Queue: 26
S/W Transmit Queue Overflow: 0
Current S/W+H/W Transmit Queue Length: 1
Current S/W+H/W Transmit Queue Length: 1

Broadcast Packets: 11 Broadcast Packets: 39014
Multicast Packets: 2 Multicast Packets: 0
No Carrier Sense: 0 CRC Errors: 0
DMA Underrun: 0 DMA Overrun: 0
Lost CTS Errors: 0 Alignment Errors: 0
Max Collision Errors: 0 No Resource Errors: 0
Late Collision Errors: 0 Receive Collision Errors: 0
Deferred: 0 Packet Too Short Errors: 0
SQE Test: 0 Packet Too Long Errors: 0
Timeout Errors: 0 Packets Discarded by Adapter: 0
Single Collision Count: 0 Receiver Start Count: 0
Multiple Collision Count: 0
Current HW Transmit Queue Length: 1

General Statistics:
-------------------
No mbuf Errors: 0
Adapter Reset Count: 0
Adapter Data Rate: 200
Driver Flags: Up Broadcast Running
Simplex AlternateAddress 64BitSupport
PrivateSegment DataRateSet

IBM 4-Port 10/100 Base-TX Ethernet PCI Adapter (23100020) Specific Statistics:
------------------------------------------------
Chip Version: 26
RJ45 Port Link Status : up
Media Speed Selected: 100 Mbps Full Duplex
Media Speed Running: 100 Mbps Full Duplex
Receive Pool Buffer Size: 384
Free Receive Pool Buffers: 125
No Receive Pool Buffer Errors: 0
Inter Packet Gap: 96
Adapter Restarts due to IOCTL commands: 1
Packets with Transmit collisions:
1 collisions: 0 6 collisions: 0 11 collisions: 0
2 collisions: 0 7 collisions: 0 12 collisions: 0
2 collisions: 0 7 collisions: 0 12 collisions: 0
3 collisions: 0 8 collisions: 0 13 collisions: 0
4 collisions: 0 9 collisions: 0 14 collisions: 0
5 collisions: 0 10 collisions: 0 15 collisions: 0
Excessive Deferrals: 0
-------------------------------------------------------------
ETHERNET STATISTICS (ent2) :
Device Type: IBM 4-Port 10/100 Base-TX Ethernet PCI Adapter (23100020)
Hardware Address: 00:09:6b:4e:86:21
Elapsed Time: 0 days 17 hours 24 minutes 2 seconds

Transmit Statistics: Receive Statistics:
-------------------- -------------------
Packets: 32161 Packets: 62878
Bytes: 3870723 Bytes: 21751977
Interrupts: 52 Interrupts: 60624
Transmit Errors: 0 Receive Errors: 0
Packets Dropped: 1 Packets Dropped: 0
Bad Packets: 0
Max Packets on S/W Transmit Queue: 11
S/W Transmit Queue Overflow: 0
Current S/W+H/W Transmit Queue Length: 1

Broadcast Packets: 6 Broadcast Packets: 32315
Multicast Packets: 2 Multicast Packets: 0
No Carrier Sense: 0 CRC Errors: 0
DMA Underrun: 0 DMA Overrun: 0
Lost CTS Errors: 0 Alignment Errors: 0
Max Collision Errors: 0 No Resource Errors: 0
Late Collision Errors: 0 Receive Collision Errors: 0
Deferred: 0 Packet Too Short Errors: 0
SQE Test: 0 Packet Too Long Errors: 0
Timeout Errors: 0 Packets Discarded by Adapter: 0
Single Collision Count: 0 Receiver Start Count: 0
Multiple Collision Count: 0
Current HW Transmit Queue Length: 1

General Statistics:
-------------------
-------------------
No mbuf Errors: 0
Adapter Reset Count: 0
Adapter Data Rate: 200
Driver Flags: Up Broadcast Running
Simplex AlternateAddress 64BitSupport
PrivateSegment DataRateSet

IBM 4-Port 10/100 Base-TX Ethernet PCI Adapter (23100020) Specific Statistics:
------------------------------------------------
Chip Version: 26
RJ45 Port Link Status : up
Media Speed Selected: 100 Mbps Full Duplex
Media Speed Running: 100 Mbps Full Duplex
Receive Pool Buffer Size: 384
Free Receive Pool Buffers: 128
No Receive Pool Buffer Errors: 0
Inter Packet Gap: 96
Adapter Restarts due to IOCTL commands: 1
Packets with Transmit collisions:
1 collisions: 0 6 collisions: 0 11 collisions: 0
2 collisions: 0 7 collisions: 0 12 collisions: 0
3 collisions: 0 8 collisions: 0 13 collisions: 0
4 collisions: 0 9 collisions: 0 14 collisions: 0
5 collisions: 0 10 collisions: 0 15 collisions: 0
Excessive Deferrals: 0
-------------------------------------------------------------
ETHERNET STATISTICS (ent3) :
Device Type: IBM 4-Port 10/100 Base-TX Ethernet PCI Adapter (23100020)
Hardware Address: 00:09:6b:4e:86:22
Elapsed Time: 0 days 17 hours 23 minutes 57 seconds

Transmit Statistics: Receive Statistics:
-------------------- -------------------
Packets: 0 Packets: 32320
Bytes: 0 Bytes: 16255596
Interrupts: 0 Interrupts: 30079
Transmit Errors: 0 Receive Errors: 0
Packets Dropped: 0 Packets Dropped: 0
Packets Dropped: 0 Packets Dropped: 0
Bad Packets: 0
Max Packets on S/W Transmit Queue: 1
S/W Transmit Queue Overflow: 0
Current S/W+H/W Transmit Queue Length: 1

Broadcast Packets: 0 Broadcast Packets: 32319
Multicast Packets: 0 Multicast Packets: 1
No Carrier Sense: 0 CRC Errors: 0
DMA Underrun: 0 DMA Overrun: 0
Lost CTS Errors: 0 Alignment Errors: 0
Max Collision Errors: 0 No Resource Errors: 0
Late Collision Errors: 0 Receive Collision Errors: 0
Deferred: 0 Packet Too Short Errors: 0
SQE Test: 0 Packet Too Long Errors: 0
Timeout Errors: 0 Packets Discarded by Adapter: 0
Single Collision Count: 0 Receiver Start Count: 0
Multiple Collision Count: 0
Current HW Transmit Queue Length: 1

General Statistics:
-------------------
No mbuf Errors: 0
Adapter Reset Count: 0
Adapter Data Rate: 200
Driver Flags: Up Broadcast Running
Simplex AlternateAddress 64BitSupport
PrivateSegment DataRateSet

IBM 4-Port 10/100 Base-TX Ethernet PCI Adapter (23100020) Specific Statistics:
------------------------------------------------
Chip Version: 26
RJ45 Port Link Status : up
Media Speed Selected: 100 Mbps Full Duplex
Media Speed Running: 100 Mbps Full Duplex
Receive Pool Buffer Size: 384
Free Receive Pool Buffers: 128
No Receive Pool Buffer Errors: 0
Inter Packet Gap: 96
Adapter Restarts due to IOCTL commands: 1
Packets with Transmit collisions:
1 collisions: 0 6 collisions: 0 11 collisions: 0
2 collisions: 0 7 collisions: 0 12 collisions: 0
3 collisions: 0 8 collisions: 0 13 collisions: 0
4 collisions: 0 9 collisions: 0 14 collisions: 0
5 collisions: 0 10 collisions: 0 15 collisions: 0
Excessive Deferrals: 0
-------------------------------------------------------------
ETHERNET STATISTICS (ent4) :
Device Type: IBM 4-Port 10/100 Base-TX Ethernet PCI Adapter (23100020)
Hardware Address: 00:09:6b:4e:86:23
Elapsed Time: 0 days 0 hours 0 minutes 0 seconds

Transmit Statistics: Receive Statistics:
-------------------- -------------------
Packets: 0 Packets: 0
Bytes: 0 Bytes: 0
Interrupts: 0 Interrupts: 0
Transmit Errors: 0 Receive Errors: 0
Packets Dropped: 0 Packets Dropped: 0
Bad Packets: 0
Max Packets on S/W Transmit Queue: 0
S/W Transmit Queue Overflow: 0
Current S/W+H/W Transmit Queue Length: 0

Broadcast Packets: 0 Broadcast Packets: 0
Multicast Packets: 0 Multicast Packets: 0
No Carrier Sense: 0 CRC Errors: 0
DMA Underrun: 0 DMA Overrun: 0
Lost CTS Errors: 0 Alignment Errors: 0
Max Collision Errors: 0 No Resource Errors: 0
Late Collision Errors: 0 Receive Collision Errors: 0
Deferred: 0 Packet Too Short Errors: 0
SQE Test: 0 Packet Too Long Errors: 0
Timeout Errors: 0 Packets Discarded by Adapter: 0
Single Collision Count: 0 Receiver Start Count: 0
Multiple Collision Count: 0
Current HW Transmit Queue Length: 0

General Statistics:
-------------------
No mbuf Errors: 0
Adapter Reset Count: 0
Adapter Data Rate: 200
Driver Flags: Up Broadcast Running
Simplex 64BitSupport PrivateSegment
DataRateSet

IBM 4-Port 10/100 Base-TX Ethernet PCI Adapter (23100020) Specific Statistics:
------------------------------------------------
Chip Version: 26
RJ45 Port Link Status : down
Media Speed Selected: Auto negotiation
Media Speed Running: Unknown
Receive Pool Buffer Size: 384
Free Receive Pool Buffers: 128
No Receive Pool Buffer Errors: 0
Inter Packet Gap: 96
Adapter Restarts due to IOCTL commands: 0
Packets with Transmit collisions:
1 collisions: 0 6 collisions: 0 11 collisions: 0
2 collisions: 0 7 collisions: 0 12 collisions: 0
3 collisions: 0 8 collisions: 0 13 collisions: 0
4 collisions: 0 9 collisions: 0 14 collisions: 0
5 collisions: 0 10 collisions: 0 15 collisions: 0
Excessive Deferrals: 0
-------------------------------------------------------------
ETHERNET STATISTICS (ent5) :
Device Type: Gigabit Ethernet-SX PCI-X Adapter (14106802)
Hardware Address: 00:02:55:33:3f:dc
Elapsed Time: 0 days 17 hours 23 minutes 53 seconds

Transmit Statistics: Receive Statistics:
-------------------- -------------------
Packets: 7 Packets: 38965
Bytes: 984 Bytes: 16654386
Interrupts: 0 Interrupts: 36550
Transmit Errors: 0 Receive Errors: 0
Packets Dropped: 0 Packets Dropped: 0
Bad Packets: 0
Max Packets on S/W Transmit Queue: 1
S/W Transmit Queue Overflow: 0
Current S/W+H/W Transmit Queue Length: 0

Broadcast Packets: 6 Broadcast Packets: 32703
Multicast Packets: 1 Multicast Packets: 6262
No Carrier Sense: 0 CRC Errors: 0
DMA Underrun: 0 DMA Overrun: 0
Lost CTS Errors: 0 Alignment Errors: 0
Max Collision Errors: 0 No Resource Errors: 0
Late Collision Errors: 0 Receive Collision Errors: 0
Deferred: 0 Packet Too Short Errors: 0
SQE Test: 0 Packet Too Long Errors: 0
Timeout Errors: 0 Packets Discarded by Adapter: 0
Single Collision Count: 0 Receiver Start Count: 0
Multiple Collision Count: 0
Current HW Transmit Queue Length: 0

General Statistics:
-------------------
No mbuf Errors: 0
Adapter Reset Count: 0
Adapter Data Rate: 2000
Driver Flags: Up Broadcast Running
Simplex 64BitSupport ChecksumOffload
PrivateSegment DataRateSet

Gigabit Ethernet-SX PCI-X Adapter (14106802) Specific Statistics:
--------------------------------------------------------------------
Link Status: Up
Media Speed Selected: Auto negotiation
Media Speed Running: 1000 Mbps Full Duplex
PCI Mode: PCI-X (100-133)
PCI Bus Width: 64-bit
Jumbo Frames: Disabled
TCP Segmentation Offload: Enabled
TCP Segmentation Offload Packets Transmitted: 0
TCP Segmentation Offload Packet Errors: 0
Transmit and Receive Flow Control Status: Enabled
XON Flow Control Packets Transmitted: 0
XON Flow Control Packets Received: 0
XOFF Flow Control Packets Transmitted: 0
XOFF Flow Control Packets Received: 0
Transmit and Receive Flow Control Threshold (High): 32768
Transmit and Receive Flow Control Threshold (Low): 24576
Transmit and Receive Storage Allocation (TX/RX): 16/48

root@b4 :/ > lsattr -El ent0
alt_addr 0x000000000000 Alternate ethernet address True
busintr 323 Bus interrupt level False
busmem 0xe0080000 Bus memory address False
chksum_offload yes Enable hardware transmit and receive checksum True
copy_bytes 2048 Copy packet if this many or less bytes True
flow_ctrl yes Enable Transmit and Receive Flow Control True
intr_priority 3 Interrupt priority False
jumbo_frames no Transmit jumbo frames True
large_send yes Enable hardware TX TCP resegmentation True
media_speed Auto_Negotiation Media speed True
rom_mem 0xe0040000 ROM memory address False
rx_hog 1000 RX buffers processed per RX interrupt True
rxbuf_pool_sz 1024 RX descriptor queue size True
rxdesc_que_sz 1024 RX descriptor queue size True
slih_hog 10 Interrupt events processed per interrupt True
tx_que_sz 8192 Software transmit queue size True
txdesc_que_sz 512 TX descriptor queue size True
use_alt_addr no Enable alternate ethernet address True

sorry but we don't have lsof installed. Hope this information helps.

 

[raztaboule]

I dont' see something wrong in the netstat -v

for no -a :
if i was in your shoes i will try :
no -o rfc1323=1
no -o tcp_sendspace=1048576
no -o tcp_recvspace=1048576

Can you confirm that when you type : telnet
you have to wait 1 minute before having the promt telnet> ?
if yes :
- how the commands unrelated to network behave ?
- what the r column of vmstat says ?

 

[lblauen]

yes it take almost 1 minute for tn , ftp or ping to start.

root@b4 :/ > vmstat
kthr memory page faults cpu
----- ----------- ------------------------ ------------ -----------
r b avm fre re pi po fr sr cy in sy cs us sy id wa
1 1 127901 1411173 0 0 0 0 0 0 350 1459 910 0 0 99 0

 

[unixfreak]

Do you have a directory called /var/yp/binding?

Cheers

 

[lblauen]

Yes I do have /var/yp/binding. Whats it for?

 

[lblauen]

Finally got it fixed. It was nisplus causing the problems. I removed it and everything is running fine now. Thanks for the help and suggestions.

 

[raztaboule]

what is nisplus ?