Continuous Dump Fails

[program0]

Hi all,
got a serious problem at the moment. 56 lim BC13 system with 2 x HDU 7 with split RELs.
Over the last couple of months i have had more dump fails than successes, both on Autodump and manula DUSYI. HDU formats tend to sort the problem for a few days but the main failure is down to buffer transfer errors regardless of when the dumps run (usually set for 02-30hrs)

My system maintainer has been looking at the problem and has suggested moving the LPU to increase t/s availability. I have noted is that my LPU5 is in the dedicated LPU slot (Lim1 is currently an old /90 cabinet)and therefore has only 4 x positions available. i have 1-0-70 available (with no other cards in associated positions) and want to move the LPU to this to increase the t/s availability (my NIU2 has 16 active slots in 1-0-60) and see if this helps.
however, at the moment i have no valid RLs and ALEX suggests that moving the LPU will cause a Lim Reload!
Bit of a catch 22!!

Any suggestions would be appreciated

Steve

It's never too late to try something new

 

[whosrdaddy]

some questions :

your pcm system links, are they stable? (check gjlsprint=faulty)

could you printout allop; and hiedp; ?

/Daddy

-----------------------------------------------------
What You See Is What You Get
Never underestimate tha powah of tha google!

 

[program0]

Hi Whosrdaddy
just in the middle of another dusyi (we have contractors in this weekend messing with power so i really need a valid backup just in case)
all links are ok at the moment 9i do get slip alarms now and again from lim56)
here are the prints valid at the mo'

CADAP;
CALENDAR DATA
IDENTITY=121843-LANCSC-C
VERSION=CXP1010102/4/TSWSP2GB1.14/R3A
12:31:18
FRI 22 AUG 2008
END

<ALLOP;
ALARM LOG
IDENTITY: 121843-LANCSC-C
VERSION: CXP1010102/4/TSWSP2GB1.14/R3A

DATE: 22AUG08 TIME: 12:31:21
CLASS: 2
820 LIM30TEST
DATE TIME ALP NOIF EQU BRDID
22AUG08 08:27:34 1 3 030-0-22-00 19

CLASS: 1
274 DIGITAL TRUNK, CLOCK MALFUNCTION (SLIP)
DATE TIME ALP NOIF UNIT EQU BRDID INF1
22AUG08 08:28:48 3 3 SLP60 036-2-50-00 57 256

114 DEVICE BOARD HAS BEEN ACTIVATED
DATE TIME ALP NOIF EQU BRDID
22AUG08 10:13:33 12 1 001-0-60-00 106

85 BUFFER TRANSFER HAS FAILED
DATE TIME ALP NOIF EQU BRDID INF1 INF2 INF3 INF4
22AUG08 10:13:54 13 1 001-0-60-00 106 301 0 31 1

274 DIGITAL TRUNK, CLOCK MALFUNCTION (SLIP)
DATE TIME ALP NOIF UNIT EQU BRDID INF1
22AUG08 12:11:18 21 1 TLP50 024-1-50-00 48 262

274 DIGITAL TRUNK, CLOCK MALFUNCTION (SLIP)
DATE TIME ALP NOIF UNIT EQU BRDID INF1
22AUG08 12:14:15 20 2 TLP50 033-1-30-00 48 263

355 IP DEVICE BOARD, UNACCEPTABLE QUALITY OF SERVICE
DATE TIME ALP NOIF UNIT EQU BRDID INF1
22AUG08 12:31:18 7 30 IPLP 043-2-30-00 114 1

CLASS: 0
274 DIGITAL TRUNK, CLOCK MALFUNCTION (SLIP)
DATE TIME ALP NOIF UNIT EQU BRDID INF1
22AUG08 08:27:57 2 2 TLP50 001-1-40-00 48 263
RDATE RTIME
22AUG08 09:48:31
260 FAULT ON LINE TO INTERWORKING PABX OR PUBLIC EXCHANGE
DATE TIME ALP NOIF UNIT EQU BRDID INF1 INF2
22AUG08 09:10:33 5 16 TLP1 028-1-72-03 75 98 1
RDATE RTIME
22AUG08 09:10:33
287 CONGESTION SUPERVISION VALUE REACHED FOR PCM-LINE
DATE TIME ALP NOIF UNIT EQU INF1 INF2 INF3
22AUG08 09:45:00 10 1 GSP 051-*-**-** 941 599 10
RDATE RTIME
22AUG08 10:00:00
274 DIGITAL TRUNK, CLOCK MALFUNCTION (SLIP)
DATE TIME ALP NOIF UNIT EQU BRDID INF1
22AUG08 09:45:52 11 2 TLP50 006-1-30-00 48 262
RDATE RTIME
22AUG08 11:15:07
270 DIGITAL TRUNK, BIT ERROR IN FRAME SYNCHRONIZATIION WORD
DATE TIME ALP NOIF UNIT EQU BRDID INF1
22AUG08 10:25:20 15 1 TLP50 003-1-40-00 48 263
RDATE RTIME
22AUG08 10:25:23
364 IP DEVICE BOARD, MINOR FAULT
DATE TIME ALP NOIF UNIT EQU BRDID INF1 INF2
22AUG08 10:37:59 8 3 IPLP 043-2-70-00 119 2 4
RDATE RTIME
22AUG08 10:38:05
34 LIM OUT OF ORDER
DATE TIME ALP NOIF EQU INF2
22AUG08 10:43:14 9 2 051-*-**-** 0
RDATE RTIME
22AUG08 10:43:14
24 FAULTY PCM LINK (GJU)
DATE TIME ALP NOIF GSSIDE GSM
22AUG08 10:43:39 16 1 0 2
RDATE RTIME
22AUG08 10:46:10
287 CONGESTION SUPERVISION VALUE REACHED FOR PCM-LINE
DATE TIME ALP NOIF UNIT EQU INF1 INF2 INF3
22AUG08 10:45:00 17 1 GSP 051-*-**-** 842 599 10
RDATE RTIME
22AUG08 11:00:00
260 FAULT ON LINE TO INTERWORKING PABX OR PUBLIC EXCHANGE
DATE TIME ALP NOIF UNIT EQU BRDID INF1 INF2
22AUG08 10:49:37 18 2 TLP1 006-0-52-01 7 97 1
RDATE RTIME
22AUG08 10:49:59
355 IP DEVICE BOARD, UNACCEPTABLE QUALITY OF SERVICE
DATE TIME ALP NOIF UNIT EQU BRDID INF1
22AUG08 10:58:18 6 26 IPLP 043-2-40-00 114 0
RDATE RTIME
22AUG08 10:58:33
274 DIGITAL TRUNK, CLOCK MALFUNCTION (SLIP)
DATE TIME ALP NOIF UNIT EQU BRDID INF1
22AUG08 11:57:24 19 1 TLP50 041-0-10-00 48 263
RDATE RTIME
22AUG08 12:05:30
260 FAULT ON LINE TO INTERWORKING PABX OR PUBLIC EXCHANGE
DATE TIME ALP NOIF UNIT EQU BRDID INF1 INF2
22AUG08 12:16:33 14 3 TLP1 019-0-60-00 75 94 1
RDATE RTIME
22AUG08 12:16:40
25 SLIP ON GROUP JUNCTOR LINE
DATE TIME ALP NOIF EQU INF1
22AUG08 12:29:44 4 53 056-0-**-** 1
RDATE RTIME
22AUG08 12:30:10
355 IP DEVICE BOARD, UNACCEPTABLE QUALITY OF SERVICE
DATE TIME ALP NOIF UNIT EQU BRDID INF1
22AUG08 12:31:18 7 30 IPLP 043-2-30-00 114 1
RDATE RTIME
22AUG08 12:31:32

LAST ALREI: 22AUG08, 08:27:34

END
<HIEDP;
TIME DATE
12:31:44 22AUG08
LIM EVENTS OVERWRITTEN OLDEST EVENT NEWEST EVENT LAST HIREI
EVENTS
001 7 0 09:38:04 22AUG08 10:21:24 22AUG08 08:27:40 22AUG08
002 0 0 08:27:39 22AUG08
003 0 0 08:27:39 22AUG08
004 0 0 08:27:40 22AUG08
005 0 0 08:27:40 22AUG08
006 4 0 09:35:27 22AUG08 09:35:28 22AUG08 08:27:40 22AUG08
007 0 0 08:27:39 22AUG08
008 0 0 08:27:40 22AUG08
009 0 0 08:27:40 22AUG08
010 0 0 08:27:40 22AUG08
011 0 0 08:27:40 22AUG08
012 0 0 08:27:40 22AUG08
013 0 0 08:27:40 22AUG08
014 0 0 08:27:40 22AUG08
015 30 0 09:35:26 22AUG08 10:43:18 22AUG08 08:27:41 22AUG08
016 21 0 11:03:01 22AUG08 11:04:37 22AUG08 08:27:40 22AUG08
017 24 0 09:35:27 22AUG08 10:43:18 22AUG08 08:27:41 22AUG08
018 0 0 08:27:41 22AUG08
019 0 0 08:27:41 22AUG08
021 0 0 08:27:41 22AUG08
022 0 0 08:27:41 22AUG08
023 0 0 08:27:41 22AUG08
024 5 0 09:35:28 22AUG08 10:43:26 22AUG08 08:27:41 22AUG08
025 0 0 08:27:41 22AUG08
026 0 0 08:27:41 22AUG08
027 0 0 08:27:42 22AUG08
028 5 0 09:35:23 22AUG08 10:43:26 22AUG08 08:27:41 22AUG08
029 0 0 08:27:42 22AUG08
030 0 0 08:27:41 22AUG08
031 1 0 10:13:26 22AUG08 10:13:26 22AUG08 08:27:42 22AUG08
032 0 0 08:27:41 22AUG08
033 0 0 08:27:42 22AUG08
034 0 0 08:27:42 22AUG08
035 0 0 08:27:42 22AUG08
036 0 0 08:27:42 22AUG08
037 1 0 11:47:21 22AUG08 11:47:21 22AUG08 08:27:42 22AUG08
038 0 0 08:27:42 22AUG08
039 1 0 08:56:54 22AUG08 08:56:54 22AUG08 08:27:42 22AUG08
040 0 0 08:27:42 22AUG08
041 0 0 08:27:42 22AUG08
042 0 0 08:27:43 22AUG08
043 1 0 10:24:11 22AUG08 10:24:11 22AUG08 08:27:43 22AUG08
044 0 0 08:27:43 22AUG08
045 0 0 08:27:43 22AUG08
046 0 0 08:27:43 22AUG08
047 0 0 08:27:43 22AUG08
048 4 0 09:35:27 22AUG08 09:35:27 22AUG08 08:27:43 22AUG08
049 0 0 08:27:43 22AUG08
050 0 0 08:27:43 22AUG08
051 0 0 08:27:44 22AUG08
052 0 0 08:27:43 22AUG08
053 0 0 08:27:44 22AUG08
054 0 0 08:27:44 22AUG08
055 0 0 08:27:44 22AUG08
056 0 0 08:27:44 22AUG08

END

seriously considering reallocating some pcm channels to dump only (VLDB) to try and give priority to the dump (maybe out of hours)

Steve




It's never too late to try something new

 

[program0]

ok failed again at 13:08
might be getting some clearer indication as to the root of the problem.last 3 DUSYI attempts have all failed at the same point with the following:-
BUFFER TRANSFER ERROR 12:59 22AUG08
FAILED IN LIM040 FOR LIM RELOAD DATA FILE

i've done an immediate Gjtsp on lim40 and all channels are FREE.
cnlip for lim40 shows not much equipped so i wouldnt have thought heavy traffic is causing the buffer overload.
HIMDP print shows following:-
<himdp:lim=40;;

DIAGNOSTICS FROM OPERATING SYSTEM
TIME DATE
13:16:49 22AUG08
DIAGNOSTICS FROM LIM 040, LAST HIREI: 08:27:42 22AUG08

TIME DATE ERROR CODE
12:59:22 22AUG08 H'44
COMMUNICATION STATUS ERROR AT BUFFER TRANSFER
SEND ERRORS, DUPLEX MODE = 001
RECEIVE ERRORS, DUPLEX MODE = 000
SEND ERRORS, SIMPLEX MODE = 000
EXE A IN LIM 048

Steve

It's never too late to try something new

 

[Satellite1900]

Hello,
you could print the log file of what fails dump.
and also how you mounted the 'HDU?
Greetings.

 

[dstrang1]

It's not an LPU timeslot or HDU problem.....it's a PCM link signalling issue.

How many links in LIM 40? If you have more than one, block, function test and restart each one individually.
You can also end signalling on one of them (or all but one)and see if it's one particular link in the LIM.


You should also (at a very low traffic period) function test and restart your group switch. I would actually do this first unless the dump failures are consistently in LIM 40. You'll get manual dump failures due to buffer transfers during high traffic periods

I think that having signalling on multiple links in a LIM causes more problems than it relieves. I also believe that the CONSONO group switch is VERY sensitive to noise and garbage -- one flaky link can reverberate thru the system and cuase you to look for problems in the wrong places. that's been my personal experience anyway (62 LIMS, CONSONO GS and 160+ links).


Good luck,

Dave Strang

 

[whosrdaddy]

try this:

// make sure you do this when you have no traffic (or low traffic)
RFPUI:UNIT=INR,LIM=ALL;
Y;
SFCEI;
Y;
DUSYIUMP=ALL;

also, if you dump problem gets solved eventually, ask your service provider to update your system to SP5 as this will increase stability.

/Daddy

-----------------------------------------------------
What You See Is What You Get
Never underestimate tha powah of tha google!

 

[program0]

cheers guys
sorry for the delay in getting back. got a successful dump on sat morning.
low traffic plus i did what you suggested whosurdaddy and restarted INR in all Lims.
dstrang1 - i agree its most likely to be a PCM link. unfortunately/fortunately we only have 1 link to lim 40 but i've also got a wobbly link to Lim51 and guess what? it's a Consono.
i have already got a schedule for SP5 so hopefully it will help however i will continue to investigate the PCM problems.

thanks for all your help guys

Steve

It's never too late to try something new

 

[cv8devil]

Another thing that is worth a shot. Ensure your earthing is correct. Ericsson equipment is notorious for requiring a stable earth.
I had issues with my dumps failing and it was always LIM21. Checked the earth and once repaired the problem was resolved.