Cisco 3640 MLPPP 3 of 4 t1's errors and bouncing...

[aladoug]

Have been going back and forth with ATT for about a week now. They thought the problem with 3 of our 4 t1's bouncing and taking errors was a smart jack in another office. Well after a few days the problem is still there. 3 of the T1's are still taking errors. One of the T1's however is rock solid, no errors. When I plug this 1 t1 that has no errors in any of the other csu's it follows that circuit, so unless I'm wrong, this should help prove it's not my equipment correct? Just today I replaced the WIC's and the same problem is still there. Granted, the errors aren't all that high at time, but sometimes when they do get higher, the 3 t1's taking errors will bounce up and down for a minute or two. Any advice what to do next? I can call att and they will dispatch someone out to check it, but they said if it ends up being something on my equipment, that it will be billed at a very pricey rate....

 

[North323]

what sort of errors? crc? input? ckt bouncing?

 

[aladoug]

The one that never shows errors is currently plugged in 2/1

Serial1/0 is up, line protocol is up
Hardware is QUICC with integrated T1 CSU/DSU
MTU 1500 bytes, BW 1544 Kbit, DLY 20000 usec,
reliability 255/255, txload 18/255, rxload 128/255
Encapsulation PPP, loopback not set
Keepalive set (10 sec)
LCP Open, multilink Open
Last input 00:00:00, output 00:00:00, output hang never
Last clearing of "show interface" counters 01:55:13
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 417
Queueing strategy: weighted fair [suspended, using FIFO]
FIFO output queue 0/40, 417 drops
5 minute input rate 777000 bits/sec, 143 packets/sec
5 minute output rate 109000 bits/sec, 120 packets/sec
930231 packets input, 569386547 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 1 giants, 0 throttles
3326 input errors, 1560 CRC, 1650 frame, 0 overrun, 0 ignored, 115 abort
803398 packets output, 133287960 bytes, 0 underruns
0 output errors, 0 collisions, 10 interface resets
0 output buffer failures, 0 output buffers swapped out
20 carrier transitions
DCD=up DSR=up DTR=up RTS=up CTS=up

Serial1/1 is up, line protocol is up
Hardware is QUICC with integrated T1 CSU/DSU
MTU 1500 bytes, BW 1544 Kbit, DLY 20000 usec,
reliability 255/255, txload 23/255, rxload 133/255
Encapsulation PPP, loopback not set
Keepalive set (10 sec)
LCP Open, multilink Open
Last input 00:00:00, output 00:00:00, output hang never
Last clearing of "show interface" counters 01:58:21
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 482
Queueing strategy: weighted fair [suspended, using FIFO]
FIFO output queue 0/40, 482 drops
5 minute input rate 808000 bits/sec, 146 packets/sec
5 minute output rate 141000 bits/sec, 126 packets/sec
959829 packets input, 588634953 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
3774 input errors, 1598 CRC, 2055 frame, 0 overrun, 0 ignored, 121 abort
828135 packets output, 137996942 bytes, 0 underruns
0 output errors, 0 collisions, 10 interface resets
0 output buffer failures, 0 output buffers swapped out
20 carrier transitions
DCD=up DSR=up DTR=up RTS=up CTS=up

Serial2/0 is up, line protocol is up
Hardware is QUICC with integrated T1 CSU/DSU
MTU 1500 bytes, BW 1544 Kbit, DLY 20000 usec,
reliability 255/255, txload 22/255, rxload 134/255
Encapsulation PPP, loopback not set
Keepalive set (10 sec)
LCP Open, multilink Open
Last input 00:00:00, output 00:00:00, output hang never
Last clearing of "show interface" counters 01:58:42
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 448
Queueing strategy: weighted fair [suspended, using FIFO]
FIFO output queue 0/40, 448 drops
5 minute input rate 812000 bits/sec, 146 packets/sec
5 minute output rate 138000 bits/sec, 124 packets/sec
966446 packets input, 591577323 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
3133 input errors, 1429 CRC, 1585 frame, 0 overrun, 0 ignored, 119 abort
831717 packets output, 137950238 bytes, 0 underruns
0 output errors, 0 collisions, 9 interface resets
0 output buffer failures, 0 output buffers swapped out
18 carrier transitions
DCD=up DSR=up DTR=up RTS=up CTS=up

Serial2/1 is up, line protocol is up
Hardware is QUICC with integrated T1 CSU/DSU
MTU 1500 bytes, BW 1544 Kbit, DLY 20000 usec,
reliability 255/255, txload 20/255, rxload 128/255
Encapsulation PPP, loopback not set
Keepalive set (10 sec)
LCP Open, multilink Open
Last input 00:00:00, output 00:00:00, output hang never
Last clearing of "show interface" counters 01:59:18
Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0
Queueing strategy: weighted fair [suspended, using FIFO]
FIFO output queue 0/40, 0 drops
5 minute input rate 777000 bits/sec, 143 packets/sec
5 minute output rate 126000 bits/sec, 117 packets/sec
991077 packets input, 606727098 bytes, 0 no buffer
Received 0 broadcasts, 0 runts, 0 giants, 0 throttles
0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored, 0 abort
853559 packets output, 141484819 bytes, 0 underruns
0 output errors, 0 collisions, 0 interface resets
0 output buffer failures, 0 output buffers swapped out
0 carrier transitions
DCD=up DSR=up DTR=up RTS=up CTS=up

 

[aladoug]

It's funny how when the interfaces reset those 3 will go down simultaneously, then back up within 10 seconds or so.

 

[North323]

are these all bonded in the same router? can you post a config if they are?

 

[aladoug]

Yes they are all bonded in same router, using MLPPP.


Current configuration : 3607 bytes
!
version 12.2
service timestamps debug uptime
service timestamps log uptime
no service password-encryption
!
hostname Router
!
!
memory-size iomem 10
ip subnet-zero
!
!
!
call rsvp-sync
!
!
!
!
!
fax interface-type modem
mta receive maximum-recipients 0
!
!
!
interface Multilink1
ip address 12.125.23.98 255.255.255.252
ip access-group 141 in
ip access-group 141 out
no cdp enable
ppp multilink
no ppp multilink fragmentation
multilink-group 1
!
interface FastEthernet0/0
ip address 12.166.77.1 255.255.255.252
no ip redirects
duplex auto
speed auto
!
interface FastEthernet0/1
no ip address
shutdown
duplex auto
speed auto
!
interface Ethernet1/0
no ip address
shutdown
half-duplex
!
interface Serial1/0
no ip address
encapsulation ppp
no cdp enable
ppp multilink
multilink-group 1
!
interface Ethernet1/1
no ip address
shutdown
half-duplex
!
interface Serial1/1
no ip address
encapsulation ppp
no cdp enable
ppp multilink
multilink-group 1
!
interface Ethernet2/0
no ip address
shutdown
half-duplex
!
interface Serial2/0
no ip address
encapsulation ppp
no cdp enable
ppp multilink
multilink-group 1
!
interface Ethernet2/1
no ip address
shutdown
half-duplex
!
interface Serial2/1
no ip address
encapsulation ppp
no cdp enable
ppp multilink
multilink-group 1
!
ip nat pool natpool 12.166.64.5 12.166.64.7 netmask 255.255.254.0
ip nat inside source list 10 pool natpool overload
ip classless
ip route 0.0.0.0 0.0.0.0 Multilink1
ip route 10.1.0.0 255.255.0.0 12.166.77.2
ip route 12.108.233.0 255.255.255.0 12.166.77.2
ip route 12.166.64.0 255.255.254.0 12.166.77.2
ip route 12.166.76.0 255.255.255.0 12.166.77.2
ip route 12.166.77.4 255.255.255.252 12.166.77.2
ip route 12.166.77.64 255.255.255.192 12.166.77.2
ip route 12.166.77.128 255.255.255.128 12.166.77.2
no ip http server
ip pim bidir-enable
!
access-list 10 permit 12.151.234.0 0.0.0.255
access-list 10 permit 10.1.0.0 0.0.255.255
access-list 20 permit 12.108.233.0 0.0.0.255
access-list 20 permit 12.166.76.0 0.0.0.254
access-list 20 permit 12.151.234.0 0.0.0.255
access-list 141 deny ip host 61.39.136.94 any log
access-list 141 deny ip host 202.99.236.44 any log
access-list 141 deny ip host 213.93.161.194 any log
access-list 141 deny ip host 218.148.68.217 any log
access-list 141 deny ip host 210.205.6.133 any log
access-list 141 deny ip host 202.134.71.197 any log
access-list 141 deny ip host 217.68.188.106 any log
access-list 141 deny ip host 199.34.26.67 any log
access-list 141 deny ip host 62.220.105.133 any log
access-list 141 deny ip host 67.93.147.67 any log
access-list 141 deny ip host 70.84.241.130 any log
access-list 141 deny tcp any any eq 135
access-list 141 deny tcp any any eq 136
access-list 141 deny tcp any any eq 137
access-list 141 deny tcp any any eq 138
access-list 141 deny tcp any any eq 139
access-list 141 deny tcp any any eq 69
access-list 141 deny tcp any any eq 4444
access-list 141 deny tcp any any eq 5554
access-list 141 deny tcp any any eq 445
access-list 141 deny tcp any any eq 9996
access-list 141 deny udp any any eq tftp
access-list 141 deny udp any any eq 135
access-list 141 deny udp any any eq 4444
access-list 141 deny udp any any eq netbios-ns
access-list 141 deny udp any any eq netbios-ss
access-list 141 deny udp any any eq netbios-dgm
access-list 141 permit ip any any
snmp-server community itc8888 RO
!
dial-peer cor custom
!
!
!
!
line con 0
line aux 0
line vty 0 4
login
!
end

 

[burtsbees]

All same amount of carrier transitions and resets, all input errors. Did the LEC do an aggressive test to the smartjack, including loopback? Have you tried a loopback plug at your smartjack? Three out of four, and the good one being in the same NM as a bad one, all point to the LEC. Are they all plugged into the same smartjack?

/

tim@tim-laptop ~ $ sudo apt-get install windows
Reading package lists... Done
Building dependency tree
Reading state information... Done
E: Couldn't find package windows...Thank Goodness!