Expansion VoIP - DSP failure on NS700 with 6 SIP trunks 2

[Jonah29]

Hi All,
I have an NS700 Ver 8 with 6 SIP ch, 4 x UM ports and 5 x IP Phones plus about 70 x Dig Propietry phones. For a week or so there has been an error showing up in the log = Expansion VoIP - DSP failure Error code = 224 Sub Code = 10091. It shows up periodically throughout the day and night, everyday. I have checked the DSP card is seated correctly and changed the DSP-S card. It seemed to be ok for a day but now is showing up again. It seems to coincide with external calls cutting off.

They have also complained of UM voicemail prompts cutting off when they call in to listen to VMs. For example a user will call her mailbox to listen to messages and the prompt to welcome her to her mbx will stop before it gets to the please enter your PIN. The call doesn't actually disconnect the prompt just stops short.

Long before the DSP-S error has been showing up they have been having problems with the audio on the external calls on the SIP breaking up. The SIP endpoint is directed to the client's own Leased Line Internet Connection and the system is on their LAN with no VLAN. SIP providor says they are sending good clear audio but seeing a 1% packet loss and saying problem must be with ISP or LAN. Pana config is fine, same settings as I use on all. Client is looking to me to tell him whether problem is in ISP or LAN and I don't really know how I can tell him. I have asked him to check with ISP that all our port forwarding rules are in place and make sure SIP ALG and SIP Helpers are disabled, suggesting that they give highest priority/QoS to our RTP Voice packets and suggesting they reserve some bandwidth for voice. Client finds ISP is very difficult to deal with and never get straight answers to any of requests.

Are these issues related perhaps?
To try and resolve the Expansion VoIP - DSP failure Error code = 224 Sub Code = 10091 I am now going to change the Main NS700 unit as I don't know what else could be causing it.

Any suggestions?

Regards
Mark

 

[obtsystems]

Have you run wireshark on the system to see what is happening. If the audio is coming in ok from the provider it will show it on the trace.

Could be the 700, it could be the power supply definitely worth try to swap out to test and get a 30 day temp license from Panasonic to try it

 

[Jonah29]

Hi obt,
Well to be honest i have got the pcap from the Pana itself and have sent it to the support people where I bought the kit from but they haven't really said whether it shows if the audio is good from SIP provider and ISP. I don't really have in depth knowledge of Wireshark.... Yet. I'm trying to arrange a training course to attend.
Upon an ex colleague's advice I am trying to get the IT guy to set up port mirroring on the switch the router comes in to so I can run Wireshark on it and recreate the fault. He said I should then be able to find the bad calls in the capture and listen to the actual audio and verify whether it is arriving from the router with bad quality and missing parts of the conversation.

I changed the CCU yesterday, installed some temp lic keys and uploaded the programming DB back in to it. The DSP error Expansion VoIP - DSP failure Error code = 224 Sub Code = 10091 is still showing up!! So it's a replacement CCU and a new DSP-S now and the error is still being listed in the log.

Okay so thinking back the Expansion VoIP - DSP failure Error code = 224 Sub Code = 10091 only started showing in the error log after I set the system to upgrade to ver. 7 from ver. 6 and since then I have upgraded to ver.8. Based on this I have decided to roll the firmware back to Ver. 6.00094 which I am struggling to do. Whenever I try to download an earlier version it fails. This is just at the download from my "local PC" stage, not even at the actual upgrade stage. I have tried various browsers, I have tried rebooting the system, I have managed to downgrade the expansion shelves and the only time i can get a successful PMPR download is when I re-download ver. 8, which is the current version. Can I downgrade the system? Any ideas why the earlier firmware file is failing to download? In the bottom left hand corner of the browser I can see the percentage progress counts up from 1% to 100% so I think it is transferring the entire file.
I'm struggling with this one. Any clues?
Regards
Mark

 

[obtsystems]

Does that error come up a lot. If you cleared the log does it come back straight away

The error log codes say ignore if not regularly coming up

I have an netgear gs105 with a mirror port setup on it so I can do traces without needing IT to do anything.

Could be something bombarding the system on the network causing the problem

 

[Jonah29]

Hi,
Thanks for responding OBT.
Is it possible to install older versions of firmware e.g. to go back from Ver 8 to ver 6?

Yes I saw that suggestion in the log codes pdf about ignoring the error if it is occasional but it is appearing on average 6 x times a day, everyday. And some times in the middle of the night, I need to look through the pcap for these occasions to see if these errors in the small hours coincide with any phone calls. I have not cleared the log at all yet. It appeared in the error log immediately yesterday when I first booted up the replacement ccu. I think it was plugged into the network at that point.

I have had the same thoughts that the network could be triggering the error.

With regard to the mirror if, for whatever reason, they can’t set up a port mirror on the switch I was advised to get an old Netgear hub to install between the router and switch and the hub will broadcast everything to all its ports in a similar way to mirroring.

I will clear the log and see what happens.
Regards
Mark.

 

[obtsystems]

It is very hard to get an old hub, that’s why I got the one I have because it is small and has mirror abilities plus fits in mt laptop bag

I would put it between the system lan and the switch, that way you only get data for the system and not the whole network

 

[Jonah29]

Morning OBT,
I am going to set their ccu and original DSP-S card on test at the office and see if the error still gets logged.
Apologies for asking again but is it actually possible to roll the firmware back to one of the version 6 levels? I can’t seem to download the PMPR file from my laptop to the ccu. Thanks for your responses and advice, much appreciated.
Mark

 

[obtsystems]

I think it is possible, but I never had to do it.

What error are you getting?
I can check my notes and see if its in there, if not I can ask Panasonic if possible

 

[Jonah29]

Hi,
I will try and reply with a screenshot of the message I get.
Thanks
Mark.

 

[Jonah29]

Hi OBT,
Attached is a screenshot of what happens after it has got to 100% in the bottom left hand corner. There is also a screenshot of the Update program page which shows you that ver. 8 is available as well as a lower version of expansion shelf firmware. I have successfully down graded the exp shelves. There is also a screen shot of the syslog for these events. As you can see by my numerous attempts it says something about it being restricted. I'm only doing this because the DSP error only started showing after an upgrade from Ver.6 to ver.7
See what you think anyway
Thanks

Mark

 

[obtsystems]

I have been looking for roll back instructions and can’t find it. I will check with Panasonic for process

 

[Jonah29]

Thanks OBT.

 

[Jonah29]

Hi OBT,
I took some traces yesterday from a port mirror using Wireshark (latest version) but when I came to play the audio stream nothing played yet they were my test calls so I know there was audio. Codec = G711a. Am I missing a plugin for wireshark or something?

Regards
Mark

 

[ingy500]

Hi all
-The previous version cannot be used after the update to the top
-You can test sip trunk By X-Lite With ISP service provider

 

[Jonah29]

Hi ingy,
Thanks for the update, a bit disappointing though.