err 057 phones falling asleep 1

[flingarrows]

Here is a little history:
3 cabinet opt11 rls 4.5, patched

3rd cabinet lost power 3 weeks ago. Main cabinet lost the power supply last week.

Random phones across all 3 cabinets, 4-6 per week, go dead and are disabled when mids runs 30.

history file shows err057's for the sets. enabling set, and unplugging/replugging clears trouble.

Next week same thing happens to different sets.

This only started happening 3 week ago.

Am I looking at a flakey NTDK20?

 

[johnpoole]

i would replace at least one digital line card 1st... could be the 20, i usually suspect the 02 1st

john poole
bellsouth business
columbia,sc

 

[flingarrows]

ok, i'll try the 02 with the most failures 1st.

 

[curtismo]

I have found the ERR057 when there are wiring faults (pinched cable, etc.) The only way I found to recover from an ERR057 is out and rebuild the TN. Any lighting or power issues related to the power supply failures?

 

[flingarrows]

not when the 3rd cabinet went down, which was when the trouble first started occuring



"Any lighting or power issues related to the power supply failures?

 

[flingarrows]

More info: the switch reloaded sunday night around 8:08pm. the UPS logs did not show any switch overs. the data equipment that is served off of the UPS did not have any problems. ERR057's started on about 15 sets, after the reload.

here is the rdall (pertinant portion)
320 23/8/08 1:04:16.461) SRPT770 TOD 0: Midnight job server started.
Number of jobs to do: 2
321 23/8/08 1:04:16.463) SRPT773 TOD 0: Starting midnight job 'pchMidNite'
322 23/8/08 1:04:16.466) SRPT774 TOD 0: Midnight jobs completed
323 24/8/08 1:00:00.950) SRPT770 TOD 0: Midnight job server started.
Number of jobs to do: 1
324 24/8/08 1:00:00.953) SRPT773 TOD 0: Starting midnight job 'rstThr'
325 24/8/08 1:00:00.953) SRPT774 TOD 0: Midnight jobs completed
326 24/8/08 1:02:04.501) BUG9098 createNodeRetenFile general error - Softwar
e error.
327 24/8/08 1:04:04.343) SRPT770 TOD 0: Midnight job server started.
Number of jobs to do: 2
328 24/8/08 1:04:04.345) SRPT773 TOD 0: Starting midnight job 'pchMidNite'
329 24/8/08 1:04:04.348) SRPT774 TOD 0: Midnight jobs completed
330 24/8/08 20:08:16.028) COM0008 Ethernet driver: unit 0 is being reset
331 24/8/08 20:08:16.030) COM0000 Ethernet driver: device unit 0 is initiali
zed OK.
332 24/8/08 20:08:16.030) COM0000 Ethernet driver: device unit 0 is initiali
zed OK.
333 24/8/08 20:08:16.000) RPT0005 Rpt sub-system is starting
334 24/8/08 20:08:16.011) SRPT730 OS 0: Cold Start
Release: x210450w
Created: Thu Jul 28 04:03:37 EDT 2005
335 24/8/08 20:08:26.842) PCH0110 PATCH 0 ACTIVATED. Name="p18240_1", Ref#="
ISS1:1OF1", PRS#="Q00828101", File="c:/u/patch/p18240_1.ssc"
336 24/8/08 20:08:26.981) PCH0110 PATCH 1 ACTIVATED. Name="p19908_1", Ref#="
ISS1:1OF1", PRS#="Q01067275", File="c:/u/patch/p19908_1.ssc"
337 24/8/08 20:08:27.131) PCH0110 PATCH 2 ACTIVATED. Name="p20025_1", Ref#="
ISS1:1OF1", PRS#="Q01070674", File="c:/u/patch/p20025_1.ssc"
338 24/8/08 20:08:27.310) PCH0110 PATCH 3 ACTIVATED. Name="p20588_1", Ref#="
ISS1:1OF1", PRS#="Q01166892", File="c:/u/patch/p20588_1.ssc"
339 24/8/08 20:08:27.534) PCH0110 PATCH 4 ACTIVATED. Name="p20589_1", Ref#="
ISS1:1OF1", PRS#="Q01147464", File="c:/u/patch/p20589_1.ssc"
340 24/8/08 20:08:27.687) PCH0110 PATCH 5 ACTIVATED. Name="p20616_2", Ref#="
ISS2:1OF1", PRS#="Q01165749", File="c:/u/patch/p20616_2.ssc"
341 24/8/08 20:08:31.168) PCH0110 PATCH 6 ACTIVATED. Name="p20620_1", Ref#="
ISS1:1OF1", PRS#="Q01175855", File="c:/u/patch/p20620_1.ssc"
342 24/8/08 20:08:31.435) PCH0110 PATCH 7 ACTIVATED. Name="p20676_1", Ref#="
ISS1:1OF1", PRS#="Q01062385", File="c:/u/patch/p20676_1.ssc"
343 24/8/08 20:08:31.611) PCH0110 PATCH 8 ACTIVATED. Name="p20698_1", Ref#="
ISS1:1OF1", PRS#="Q01179420", File="c:/u/patch/p20698_1.ssc"
344 24/8/08 20:08:31.738) PCH0110 PATCH 9 ACTIVATED. Name="p20708_1", Ref#="
ISS1:1OF1", PRS#="Q01174226", File="c:/u/patch/p20708_1.ssc"
345 24/8/08 20:08:31.946) PCH0110 PATCH 10 ACTIVATED. Name="p20720_1", Ref#=
"ISS1:1OF1", PRS#="Q01186606", File="c:/u/patch/p20720_1.ssc"
346 24/8/08 20:08:32.072) PCH0110 PATCH 11 ACTIVATED. Name="p20748_1", Ref#=
"ISS1:1OF1", PRS#="Q01189788", File="c:/u/patch/p20748_1.ssc"
347 24/8/08 20:08:32.199) PCH0110 PATCH 12 ACTIVATED. Name="p20758_1", Ref#=
"ISS1:1OF1", PRS#=" Q01178450", File="c:/u/patch/p20758_1.ssc"
348 24/8/08 20:08:32.573) PCH0110 PATCH 13 ACTIVATED. Name="p20764_1", Ref#=
"ISS1:1OF1", PRS#="Q01190578", File="c:/u/patch/p20764_1.ssc"
349 24/8/08 20:08:33.137) PCH0110 PATCH 14 ACTIVATED. Name="p20765_1", Ref#=
"ISS1:1OF1", PRS#="Q01080847", File="c:/u/patch/p20765_1.ssc"
350 24/8/08 20:08:33.909) RPT0001 Begin suppression of PCH0110
351 24/8/08 20:09:10.917) SRPT750 INI 0: INI on side 0 due to System Cold St
art
352 24/8/08 20:09:38.352) SRPT752 INI 0: INI completed in 28 seconds
353 24/8/08 20:09:38.385) ELAN019 ELAN Server enabled after M1 INIT
354 24/8/08 20:09:59.647) RPT0002 End suppression of PCH0110
355 24/8/08 20:09:59.646) ELAN014 ELAN 16 host IP=137.135.128.200 is enabled
356 24/8/08 20:13:58.859) BUG9098 createNodeRetenFile general error - Softwa
re error.
357 24/8/08 20:33:38.131) SEC0029 Security Warning: This system contains ins
ecure passwords, notify your system administrator
358 24/8/08 20:58:35.791) SEC0029 Security Warning: This system contains ins
ecure passwords, notify your system administrator
359 25/8/08 1:00:00.209) SRPT770 TOD 0: Midnight job server started.
Number of jobs to do: 1
360 25/8/08 1:00:00.363) SRPT773 TOD 0: Starting midnight job 'rstThr'
361 25/8/08 1:00:00.364) SRPT774 TOD 0: Midnight jobs completed
362 25/8/08 1:02:51.333) BUG9098 createNodeRetenFile general error - Softwar
e error.
363 25/8/08 1:04:50.327) SRPT770 TOD 0: Midnight job server started.
Number of jobs to do: 2
364 25/8/08 1:04:50.329) SRPT773 TOD 0: Starting midnight job 'pchMidNite'
365 25/8/08 1:04:50.332) SRPT774 TOD 0: Midnight jobs completed
366 25/8/08 10:27:35.787) SEC0029 Security Warning: This system contains ins
ecure passwords, notify your system administrator
367 25/8/08 11:38:31.715) BUG9098 createNodeRetenFile general error - Softwa
re error.
368 25/8/08 12:08:32.507) SEC0029 Security Warning: This system contains ins
ecure passwords, notify your system administrator
value = 0 = 0x0


here is the history file:
REQ prt
TYPE ahst
% SYS0000 000400 000000 000000 000000 SYSLOAD HAS TAKEN PLACE CPU 0
% SYSDB RLS/ISS: 450W LOADED FROM C: DATE/TIME: 24/8/2008 01:01:22 RECS: 130 SEQ
NO: 1032
% SYSLOAD ISSUE 4.50W: IDLE_SET_DISPLAY IDO
% INI000 00000000 20 09 16 00000000 00000000 00000000 00000000 00000000
% SRPT752 INI 0: INI completed in 28 seconds
%
% DSET000 DOWN LOAD 2545 0 198 2 0 0 0 226835
%
% INI002 0000008C 0000008D 0000008E 0000008F
%
% INI003 000000B0 000000B4 000000CE 000000D0 000000D4 000000D8 000000EF
%
% ELAN019 ELAN Server enabled after M1 INIT
%
% XMI002 XFIL 1
%
% XMI002 XFIL 3
%
% XMI002 5 EXUT
%
% XMI002 7 MGATE
%
% XMI002 8 MGATE
%
% XMI007 8
%
% XMI002 9 XDLC
%
% XMI002 17 XMLC
%
% XMI002 1 TMDI
%
% XMI002 12 XDLC
%
% XMI002 14 XDLC
%
% XMI002 16 XDLC
%
% XMI002 18 XMLC
%
% XMI002 19 XDLC
%
% XMI002 35 XDLC
% XMI002 37 XDLC
% XMI002 13 XDLC
% XMI002 15 XDLC
% XMI002 32 XDLC
% XMI002 34 XDLC
% XMI002 36 XMLC
% XMI002 11 EXUT
% XMI002 31 XDLC
%
% XMI002 33 XDLC
%
% XMI001 5 EXUT
%
% XMI002 5 EXUT
% DTC105 0
%
%
% ELAN014 ELAN 16 host IP=137.135.128.200 is enabled
%
% CSA003 16 20:10:08 24/08/2008
%
% TMDI300 1 FROM: SYS DSBL - SELFTESTS PASSED TO: ENBL
% TIME: 20:10:10
%
% DTA003 1
%
% PRI000 1 5
%

 

[flingarrows]

btt

 

[tnphoneman]

Update your patches first....there are ALOT more than 15 patches for this release.

Signature===========================================
Artificial Intelligence Is No Match for Natural Stupidity.

The latest survey shows that 3 out of 4 people make up 75% of the population.

The original point and click interface was a Smith & Wesson.

Red meat is not bad for you, it is the green fuzzy meat that is bad.

 

[flingarrows]

there are 40 something patches in the switch, the log file is just suppressing the print out. PSTAT is showing all patches in service


350 24/8/08 20:08:33.909) RPT0001 Begin suppression of PCH0110

 

[tnphoneman]

Here is the paste from the latest deplist. Ok you have 40 but that is still way way off.

Dependency List Contents

For PEP Download Instructions Click Here

Number Of SI PEPs Included In This Dependency List : 9
Number Of Non-SI PEPs Included In This Dependency List : 170
Total Number Of PEPs Included In This Dependency List : 179


Signature===========================================
Artificial Intelligence Is No Match for Natural Stupidity.

The latest survey shows that 3 out of 4 people make up 75% of the population.

The original point and click interface was a Smith & Wesson.

Red meat is not bad for you, it is the green fuzzy meat that is bad.

 

[tnphoneman]

You have CallPilot so this could be one problem...

MPLR21383 -Call Server sysload (or INI) caused by stack overflow when disconnecting ACD/CCR calls



Signature===========================================
Artificial Intelligence Is No Match for Natural Stupidity.

The latest survey shows that 3 out of 4 people make up 75% of the population.

The original point and click interface was a Smith & Wesson.

Red meat is not bad for you, it is the green fuzzy meat that is bad.