Definity DS1 weird provider issue

[njadmin]

Hi all, last week out of nowhere our PBX dropped all active call and then started to fail to seize the trunk for outbound calls. All channels on the stat trunk show disconnected but I can still get inbound calls. I've tested all the equipment in the switch and even swapped my TN767 card with a backup. If I busy/release it, it will show PASS for all tests then all channels show in-service/idle for about 40 seconds and then start disconnecting. I'm still able to receive call though. My carrier says they didn't change anything and I'm the only person with access to the PBX so I know that I didn't change anything. All the settings for syn and framing looks correct and the tech that was one site from the carrier was able to make a call with his test set.

Anybody ever hear of anything like this before? It's been like this since Thursday of last week (9-22-16)

Thanks

Jason

 

[joe2938]

now that makes no sense, how do you receive inbound calls from trunks that are disconnected, do a test board for ds1 location, does it pass test 138?

 

[njadmin]

I know right, no sense at all.

here's the board test
test board a16 Page 1

TEST RESULTS

Port Maintenance Name Alt. Name Test No. Result Error Code

01A16 DS1-BD 138 PASS
01A16 DS1-BD 139 PASS
01A16 DS1-BD 140 PASS
01A16 DS1-BD 141 PASS
01A16 DS1-BD 142 PASS
01A16 DS1-BD 143 PASS
01A16 DS1-BD 144 PASS
01A16 DS1-BD 145 PASS
01A16 DS1-BD 146 PASS
01A16 DS1-BD 1227 PASS
01A1601 TIE-DS1 14/16 136 FAIL
01A1601 TIE-DS1 14/16 36 PASS
01A1602 TIE-DS1 14/17 136 FAIL
01A1602 TIE-DS1 14/17 36 PASS
01A1603 TIE-DS1 14/18 136 FAIL

it goes pass fail for the rest of the ports.

and here'e a sta tru 14:
status trunk 14 Page 1

TRUNK GROUP STATUS

Member Port Service State Mtce Connected Ports
Busy

14/01 01A1606 disconnected no
14/02 01A1607 disconnected no
14/03 01A1608 disconnected no
14/04 01A1609 disconnected no
14/05 01A1610 disconnected no
14/06 01A1611 disconnected no
14/07 01A1612 disconnected no
14/08 01A1613 disconnected no
14/09 01A1614 disconnected no
14/10 01A1615 disconnected no
14/11 01A1616 disconnected no
14/12 01A1617 disconnected no
14/13 01A1618 disconnected no
14/14 01A1619 disconnected no
14/15 01A1620 disconnected no
14/16 01A1601 disconnected no 01AXX08 01B1803 ( this was me calling inbound from cell phone hearing announcement)
14/17 01A1602 disconnected no
14/18 01A1603 disconnected no
14/19 01A1604 disconnected no
14/20 01A1605 disconnected no
14/21 01A1621 disconnected no
14/22 01A1622 disconnected no
14/23 01A1623 disconnected no

 

[joe2938]

I am wondering if somehow your circuit provider made a change on their side such as an upgrade etc... I would place a call to them just to go over how the circuit is configured

 

[njadmin]

Did that, so far they can't find it and wouldn't even admit to possible changes, because this issue started at 1pm in the afternoon on a Thursday (and they don't do maintenance during the week - yeah right). So far each tech I talked with said the circuit was matching the settings I have in my switch. Since I have another circuit with them that is working I don't think it's a timing issue, I just hope they don't change that one by accident.

 

[joe2938]

This most definitely sounds like a central office issue. I would escalate this back to them for repair and insist that they come on site with test equipment to test all bearer channels

 

[njadmin]

They did that yesterday, guy hooked up the line and said he was able to seize the trunk and make a call. Settings on his tester matched what I had printed out from my system. I did get a call and email that they made a change and to retest but I'm still getting the same issue. There's gotta be like one small setting that everyone is overlooking or something.

 

[joe2938]

how exactly is your trunk group programmed?

 

[njadmin]

display trunk-group 14 Page 1 of 11
TRUNK GROUP

Group Number: 14 Group Type: tie CDR Reports: y
Group Name: Incoming T1 COR: 1 TN: 1 TAC: 279
Direction: two-way Outgoing Display? n Trunk Signaling Type:
Dial Access? n Busy Threshold: 99 Night Service:
Queue Length: 0 Incoming Destination:
Comm Type: voice Auth Code? n
Trunk Flash? n

TRUNK PARAMETERS
Trunk Type (in/out): wink/wink Incoming Rotary Timeout(sec):
Outgoing Dial Type: tone Incoming Dial Type: tone
Wink Timer(msec): 300 Disconnect Timing(msec): 500
Digit Treatment: insertion Digits: 5051
Sig Bit Inversion: none
Analog Loss Group: 9 Digital Loss Group: 13
Incoming Dial Tone? y

Disconnect Supervision - In? y Out? n
Answer Supervision Timeout: 0 Receive Answer Supervision? y

TRUNK FEATURES
ACA Assignment? n Measured: none
Internal Alert? n Maintenance Tests? y
Data Restriction? n
Glare Handling: none
Used for DCS? n
Suppress # Outpulsing? n
Seize When Maintenance Busy: neither-end

----------------------------------------------------------------------------


Incoming Tone (DTMF) ANI: no Per Call CPN Blocking Code:
Connected to CO? n Per Call CPN Unblocking Code:

Ds1 Echo Cancellation? n


ADMINISTRABLE TIMERS

Incoming Disconnect(msec): 500 Outgoing Disconnect(msec): 500
Incoming Dial Guard(msec): 70 Outgoing Dial Guard(msec): 1600
Incoming Glare Guard(msec): 1500 Outgoing Glare Guard(msec): 1500



Outgoing Seizure Response(sec): 5
Programmed Dial Pause(msec): 1500 Disconnect Signal Error(sec): 240
Flash Length(msec): 540 Incoming Incomplete Dial Alarm(sec): 255

----------------------------------------------------------------------------

END TO END SIGNALING
Tone(msec): 350 Pause(msec): 150

OUTPULSING INFORMATION
PPS: 10 Make(msec): 40 Break(msec): 60

ATMS THRESHOLDS
TTL Type: 105-w-rl Far End Test No:
TTL Vendor: TTL Contact:
Trunk Vendor: Trunk Contact:
Trunk Length:
MARGINAL UNACCEPTABLE
Min Max Min Max
1004 Hz Loss: -2 21 -2 21

-Dev +Dev -Dev +Dev
404 Hz Loss: 9 9 9 9
2804 Hz Loss: 9 9 9 9

Maximum C Message Noise: 55 55
Maximum C Notched Noise: 74 74
Minimum SRL-HI: 0 0
Minimum SRL-LO: 0 0
Minimum ERL: 0 0

Allow ATMS Busyout, Error Logging and Alarming? n
----------------------------------------------------------------------------
display ds1 a16 Page 1 of 2
DS1 CIRCUIT PACK

Location: 01A16 Name: hcgs122248nj
Bit Rate: 1.544 Line Coding: b8zs
Line Compensation: 1 Framing Mode: esf
Signaling Mode: robbed-bit




Idle Code: 11111111





Slip Detection? y Near-end CSU Type: integrated

DS1 CIRCUIT PACK

ESF DATA LINK OPTIONS

Network Management Protocol: tabs
Send ANSI-T1.403 One-Second Performance Reports? n
Far-end CSU Address: b

INTEGRATED CSU OPTIONS
Transmit LBO: 0db
Receive ALBO: 26db
Upon DTE LOS: loopback


CPE LOOPBACK JACK OPTIONS
Supply CPE Loopback Jack Power? y




I've had these trunk configured the same way for almost 6 years.

 

[joe2938]

try tweaking the trunk type from wink/wink to other types, also are you sure the 2nd ds1 card is good?

 

[njadmin]

The card I swapped? yeah it was tested good when my service company sent the big box of cards to me. I'm also getting the same results as with the card I pulled. I thinks it's highly unlikely that both cards would fail in the same way. The original card was a vintage 8 and the current is vintage 10 (from the box of cards).

Was going to try that but since we are getting calls in I can't do too much while we are open. I'll try that first thing in the morning though.

 

[njadmin]

Well they finally fixed it, calling tech said the circuit was set for dialtone and not wink-start. Don't know how they let that happen and why it took almost a week for them to compare it to my other circuit to check the config when I told them that first. Hopefully nobody else runs in to this kinda weirdness.

Now to try and get credit for being out-of-service for almost a week

 

[joe2938]

was exactly as I stated earlier, never ever trust those guys