SCN crash after firewall replaced 1

[dcs9150]

Hi

we have run into an issue where one of our multi site clients is changing carriers
at site B they have started the migration and replaced the router.

now as an outcome site B can call A but A can't call B across the SCN.
when asking the carrier they are saying they are not blocking, yet it worked till the firewall was replaced

i have tried to telnet across the network with the ports that i believe scn uses and do get a response, so i believe it is something shaping the traffic that is the issue

Site A can see site B as it shows the user we are trying to reach but we get Cause=34, No cct/chan available

any thoughts or things to check would be appreciated.

thanks

Locale: enu
21:02:40 261894907mS CMCallEvt: c0a800fc00018384 0.99204.0 22206 RAS.1: StateChange: END=A CMCSIdle->CMCSDialInitiated
21:02:40 261894907mS CMExtnEvt: v=1012 State, new=Dialling old=Idle,0,0,RAS
21:02:40 261894907mS CMTARGET: c0a800fc00018384 0.99204.0 22206 RAS.1: LOOKUP CALL ROUTE: GID=0 type=100 called_party= sub= calling=123456789@10.0.50.4 calling_sub= dir=out complete=0 ses=0
21:02:40 261894907mS CMTARGET: c0a800fc00018384 0.99204.0 22206 RAS.1: ADD TARGET (N): number= type=100 depth=1 nobar=1 setorig=1 ses=0
21:02:40 261894908mS CMCallEvt: c0a800fc00018384 0.99204.0 22206 RAS.1: StateChange: END=A CMCSDialInitiated->CMCSDialling
21:02:40 261894908mS CMExtnTx: v=RAS, p1=0
CMSetupAck
Line: type=RAS 1 Call: lid=0 id=1012 in=0
BChan: slot=21 chan=11
21:02:40 261894911mS CMExtnRx: v=RAS, p1=0
CMInformation
Line: type=NoLine 0 Call: lid=0 id=-1 in=0
Called[5403] Type=Default (100) Reason=CMDRdirect SndComp
21:02:40 261894911mS CMTARGET: c0a800fc00018384 0.99204.0 22206 RAS.1: LOOKUP CALL ROUTE: GID=0 type=100 called_party=5403 sub= calling=123456789@10.0.50.4 calling_sub= dir=out complete=1 ses=0
21:02:40 261894912mS CMTARGET: c0a800fc00018384 0.99204.0 22206 RAS.1: ADD TARGET (N): number=5403 type=100 depth=1 nobar=1 setorig=1 ses=0
21:02:40 261894912mS CMTARGET: c0a800fc00018384 0.99204.0 22206 RAS.1: SET USER: Tamara E orig=1
21:02:40 261894912mS CMTARGET: c0a800fc00018384 0.99204.0 22206 RAS.1: ADD USER: Tamara E depth=1 disallow_cw=0 dnd=1 real_call=1 group_call=0 type(CMNTypeDefault) incl(0x0) excpt(0x0), allow_redir(0) remote=c0a801fc simult 0 (0)
21:02:40 261894912mS CMTARGET: c0a800fc00018384 0.99204.0 22206 RAS.1: Direct to Remote Target: Tamara E
21:02:40 261894912mS CMTARGET: c0a800fc00018384 0.99204.0 22206 RAS.1: MakeCallToNetworkedUser Tamara E simult:0 ipad=192.168.1.252 via 192.168.1.252
21:02:40 261894913mS CMMap: a=2.17 b=0.0 Mapper::AllocateCodec allocated CMRTVocoder(f53a9fc0) resource busy 2, total 32
21:02:40 261894913mS CMTARGET: c0a800fc00018384 0.99204.0 22206 RAS.1: Targeted Failed, used local targeting: Tamara E
21:02:40 261894913mS CMTARGET: c0a800fc00018384 0.99204.0 22206 RAS.1: CancelTimer CMTCDialToneTimeout
21:02:40 261894913mS CMTARGET: c0a800fc00018384 0.99204.0 22206 RAS.1: NO INITIAL TARGETS: Tamara E
21:02:40 261894913mS CMTARGET: c0a800fc00018384 0.99204.0 22206 RAS.1: ADD USER: Tamara E depth=1 disallow_cw=0 dnd=1 real_call=1 group_call=0 type(CMNTypeDefault) incl(0x0) excpt(0x0), allow_redir(1) remote=c0a801fc simult 0 (0)
21:02:40 261894913mS CMTARGET: c0a800fc00018384 0.99204.0 22206 RAS.1: Direct to Remote Target: Tamara E
21:02:40 261894914mS CMTARGET: c0a800fc00018384 0.99204.0 22206 RAS.1: MakeCallToNetworkedUser Tamara E simult:0 ipad=192.168.1.252 via 192.168.1.252
21:02:40 261894914mS CMTARGET: c0a800fc00018384 0.99204.0 22206 RAS.1: Targeted Failed, used local targeting: Tamara E
21:02:40 261894914mS CMTARGET: c0a800fc00018384 0.99204.0 22206 RAS.1: SELECT: TRY VOICEMAIL orig_hg() orig_user(5403)
21:02:40 261894914mS CMTARGET: c0a800fc00018384 0.99204.0 22206 RAS.1: ADD VM TARGET
21:02:40 261894914mS CMTARGET: c0a800fc00018384 0.99204.0 22206 RAS.1: Voicemail for remote user Tamara E via link to PBX:192.168.1.252
21:02:40 261894914mS CMLineTx: v=17
CMRestart
Line: type=IPLine 17 Call: lid=0 id=-1 in=0
BC: CMTC=Speech CMTM=CallIndSigCon CMTR=64 CMST=Default CMU1=ULaw
UUI type=User2User [.4.] [0x00 0x34 0x00 ]
Display [enu]
Locale: enu
21:02:40 261894915mS CMTARGET: c0a800fc00018384 0.99204.0 22206 RAS.1: ADD VM TARGET: FAILED availability=0
21:02:40 261894915mS CMTARGET: c0a800fc00018384 0.99204.0 22206 RAS.1: Fallback() targeting failed
21:02:40 261894916mS PRN: CDR - TCPSend maxqueuesize=500 framecount=0 operational=1
21:02:40 261894917mS CMLOGGING: CALL:2018/01/2521:02,00:00:00,000,123456789@10.0.50.4,O,5403,5403,,,,1,,"",0,n/a
21:02:40 261894917mS CD: CALL: 0.99204.0 BState=Idle Cut=0 Music=0.0 Aend="VoiceMail" (21.11) Bend="Tamara E(5403)" [] (0.0) CalledNum=5403 (Tamara E) CallingNum=123456789@10.0.50.4 (123456789) Internal=1 Time=12 AState=Dialling
21:02:40 261894917mS CD: CALL: 0.99204.0 Deleted
21:02:40 261894917mS CMExtnEvt: RAS: CALL LOST (CMCauseNoChannel)
21:02:40 261894917mS CMCallEvt: c0a800fc00018384 0.99204.0 -1 RAS.1: StateChange: END=X CMCSDialling->CMCSCompleted
21:02:40 261894917mS CMExtnEvt: v=1012 State, new=PortRecoverDelay old=Dialling,0,0,RAS
21:02:40 261894917mS CMExtnTx: v=RAS, p1=0
CMReleaseComp
Line: type=RAS 1 Call: lid=0 id=1012 in=0
Called[5403] Type=Default (100) Reason=CMDRdirect Calling[123456789@10.0.50.4] Type=Unknown Plan=Default
BChan: slot=21 chan=11
Cause=34, No cct/chan available
21:02:40 261894917mS CMExtnEvt: RAS: CMExtnHandler::SetCurrent( id: 99204->0 )
21:02:40 261894918mS CMCallEvt: c0a800fc00018384 0.99204.0 -1 RAS.-1: StateChange: END=X CMCSCompleted->CMCSDelete
21:02:40 261894918mS CMExtnEvt: v=1012 State, new=Idle old=PortRecoverDelay,0,0,RAS
21:02:40 261894918mS CMExtnEvt: RAS: CMExtnHandler::SetCurrent( id: 0->99203 )
21:02:40 261894918mS CMLineTx: v=0
CMFacility
Line: type=SIPLine 18 Call: lid=18 id=99201 in=1
IE CMIESupplementaryService (3)
Network Facility Extension
sourceEntity: 0
destinationEntity: 0
Interpretation APDU
discardAnyUnrecognisedInvokePdu
RetrieveNotific.Invoke.CodePageISO8859-1
invokeId 48696
21:02:40 261894920mS CMExtnEvt: v=1012 State, new=Connected old=Idle,0,0,RAS
21:02:40 261894920mS CMCallEvt: 0000000000000000 0.99205.0 -1 BaseEP: DELETE CMEndpoint f1710080 TOTAL NOW=3 CALL_LIST=1
21:02:40 261894921mS CMCallEvt: END CALL:22206 (f17cef18)
21:02:40 261894921mS CMTARGET: c0a800fc00018384 0.99204.0 -1 BaseEP: ~CMTargetHandler f494d3e4 ep f483f190
21:02:40 261894921mS CMCallEvt: c0a800fc00018384 0.99204.0 -1 BaseEP: DELETE CMEndpoint f483f190 TOTAL NOW=2 CALL_LIST=1
21:02:40 261894922mS CMMap: a=21.11 b=0.0 PCGS CPReserveCodec (pcp[691]b0r1) true
21:02:40 261894922mS CMMap: PCG::UnmapBChan pcp[691]b0r1 cp_b f53ad004 other_cp_b f539f934
21:02:40 261894923mS CMMap: a=21.11 b=2.1 M02
21:02:40 261894923mS H323Evt: SESS 87cf SetOperational local 10.0.100.252:16384 remote 10.0.50.5:29696 to 0
21:02:40 261894923mS CMMap: PCG::UnmapBChan pcp[45]b1r0 cp_b f539f934 other_cp_b 0
21:02:40 261894923mS CMMap: PCG::MapBChan pcp[691]b0r1 cp_b 0 other_cp_b 0 type CGTypeSimple
21:02:40 261894923mS CMMap: PCGS CPReserveCodec for the other end (pcp[691]b0r1) true
21:02:40 261894923mS CMMap: PCG::MapBChan pcp[45]b1r0 cp_b f539f934 other_cp_b f53ad004 type CGTypeSimple
21:02:40 261894923mS CMMap: a=2.1 b=21.11 M12
21:02:40 261894924mS H323Evt: SESS 87cf SetOperational local 10.0.100.252:16384 remote 10.0.50.5:29696 to 1
21:02:40 261894924mS CMMap: a=2.17 b=0.0 Mapper::FreeCodec freed CMRTVocoder(f53a9fc0) resource busy 1, total 32
21:02:40 261894926mS CD: CALL: 18.99201.1 BState=Connected Cut=3 Music=0.0 Aend="Line 18" (0.0) Bend="General(General)" [VoiceMail] (21.11) CalledNum=General () CallingNum=123456789@10.0.50.4 (123456789) Internal=0 Time=10425 AState=Connected
21:02:40 261894927mS CMLineRx: v=17
CMRestartAck
Line: type=IPLine 17 Call: lid=0 id=-1 in=0
BC: CMTC=Speech CMTM=CallIndSigCon CMTR=64 CMST=Default CMU1=ULaw
UUI type=User2User [.4.] [0x00 0x34 0x00 ]
Display [enu]
Locale: enu
21:02:41 261895095mS RES: Thu 25/1/2018 21:02:40 FreeMem=49072820 Heap=44851768(9) Cache=4221052 MemObjs=25762(58418) CMMsg=19(21) ASN=0 Buff=5200 1353 1000 7456 5 Links=76831(81537) BTree=3231(6483) CPU=22.14% CPUStats=23.23%/13/31/739/14167/19842/00.5
4%/0/02.50% MCR=0 MCW=0
21:02:41 261895095mS RES2: IP 500 V2 9.1.10.0 build 192 Tasks=52 RTEngine=0 CMRTEngine=0 ExRTEngine=0 Timer=90 Poll=0 Ready=0 CMReady=0 CMQueue=0 VPNNQueue=0 Monitor=1 SSA=1 TCP=34(TLS=6) TAPI=2 Partner=346 ASC=1 SYS=MNTD OPT=UMNT SDSPD=2034
21:02:41 261895095mS RES4: XML MemObjs=63 PoolMem=5796992(3) FreePoolMem=5781688(0)
21:02:41 261895095mS RES5: CLog MemObjs=5027 FreePoolMem(Objs)=3796(73) TotalMem=627800

 

[Manie3]

Have you tried deleting and recreating the lines at each side?

ACSS (Manieee on a new account)

 

[mattKnight]

>when asking the carrier they are saying they are not blocking, yet it worked till the firewall was replaced

The network and network devices have been replaced in the flow between 2 sites and you are having problems since then?

Guess what Occam's razor is pointing at?

Wireshark capture on each site. I bet you'll see packets leaving site B and not reaching site A.

Take Care

Matt
I have always wished that my computer would be as easy to use as my telephone.
My wish has come true. I no longer know how to use my telephone.

 

[teletechman]

What release are you at?
Mike

 

[dcs9150]

Hi

thanks for the feedback.

release is 9.1

before we use wire shark which has never been my friend

i think we will schedule an time with the client when we can reboot and try recreating the SCN

i will update when that is done with the result


thanks!

 

[Manie3]

9.1 shouldnt require a reboot for recreating SCN lines.

As the line is down you may as well just go for it


ACSS (Manieee on a new account)

 

[teletechman]

in the SCN settings is there an option to change the transport type on 9.1. I know in 10 and up you can select websocket client and server. This changes the ports that the SCN uses. Check this and see if it fixes the issue. I am just not sure if it is available on 9.1.
Mike

 

[Manie3]

Teletechman I believe it is available on 9.1 as well.



ACSS (Manieee on a new account)

 

[dcs9150]

thanks teletechman

will try that

 

[derfloh]

It's possible with 9.1. Solved a lot of issues in the past to switch from proprietary to WebSocket.

 

[dcs9150]

thanks teletechman.

changing to websocket fixed the issue!

 

[amriddle01]

It didn't, you just avoided the issue

 

[Westi]

I am with amriddle on this.
You circumvented the new restrictions that the firewall put into place but as long as you don't switch back you should be fine and Avaya is going more and more in direction websocket anyways and may stop the proprietary option all together to force people to upgrade to newer releases. Just my paranoid thoughts on this

Joe W.

FHandw, ACSS (SME)


"This is the end of the world, make sure to buy your T-shirt before it is too late"
Original expression of my daughter

 

[dcs9150]

Amriddle01

i agree but at least the client is up!

i will forward the carrier the port info again for the SCN.
its still a bit of a ticking time bomb i would say!

thanks for the advise

 

[teletechman]

The fix I suggested comes from Avaya as they are pushing the SCNs toward websocket and away from the proprietary SCN. They told me that this will be how the SEs build the SCN from now on.
Mike

 

[Pepp77]

Yeah, I made the decision to move all SCN setups to WebSocket moving forwards, that way my support guys only have one type to deal with in the future.

| ACSS SME |

 

[IPGuru]

And another networking company gets away with either:-

1)

Telling Porkies​

2) being completely clueless about what they are doing

Probably both



Do things on the cheap & it will cost you dear

 

[teletechman]

@IPGuru I get what you are saying, IT gets away with a lot because customers never understand what they do or even care as long as it works. But they seem to think they know phones and phone systems as they have been using a phone since child hood. They don't realize that times have changed and that the phone system is more like a server than a key system. I just know that as a technician I need to fix what ails them with the tolls I can control. Avaya has given us the ability to fix this with out needing to poke prode or badger the IT people to actually fix something that they don't understand. I will use it to prove that the issue is with their IT provider and also fix it at the same time by telling them the only difference in the SCN is the ports used which IT is saying they are not blocking. It sucks that we have to spend hours figuring out that IT doesn't know how to fix their LAN or that they don't want to.
Mike