Tek-Tips is the largest IT community on the Internet today!

Members share and learn making Tek-Tips Forums the best source of peer-reviewed technical information on the Internet!

Register Log in
  • Congratulations Mike Lewis on being selected by the Tek-Tips community for having the most helpful posts in the forums last week. Way to Go!

Phones all drop and come back up

Status
Not open for further replies.
bad69cat

bad69cat

IS-IT--Management
May 28, 2010
280
US
OK - we have an option 11 at a remote site (unmanned 90% of the time) and I got a call that the phones quit working and then came back up. (Mostly 2616's). When I got down there the displays on the phones were dead and by the time I got the keys and got into the comm closet the phones had come back up!? So, I am pretty sure it's not a T1/PRI issue...sounds like a power issue or something. Any ideas on where to look? I pulled the AHST but I really don't know how to interpret it? Do you see anything that I should look at here?

>ld 22
PT2000

REQ ahst

SCH0101

REQ prt
TYPE ahst
% SYS000 000400 000000 000000 000000 CPU 0
% SYSDB RLS/ISS: 400T LOADED FROM C: DATE/TIME: 3/6/2014 01:00:30 RECS: 97 SEQNO: 207
% SYSLOAD ISSUE 4.00T: IDLE_SET_DISPLAY
% INI000 00000000 18 09 37 00000000 00000000 00000000 00000000 00000000
% DSET000 DOWN LOAD 872 0 87 0 0 0 0 183425
%
% INI003 000000B0 000000B4 000000CE 000000D0 000000D4 000000D8 000000EF
%
% SRPT752 INI 0: INI completed in 33 seconds
%
% XMI002 XFIL 1
%
% XMI002 XFIL 3
%
% XMI002 3 XUT
%
% XMI002 4 TMDI
%
% XMI002 5 XDLC
%
% XMI002 7 XDLC
%
% XMI002 9 TMDI
%
% XMI002 1 TMDI
%
% XMI002 2 TMDI
%
% XMI002 6 XDLC
%
% XMI002 8 XMLC
%
% XMI002 11 XMLC
%
% XMI002 12 XDLC
%
% XMI002 14 XDLC
%
% XMI002 13 XDLC
%
% TMDI300 2 FROM: SYS DSBL - SELFTESTS PASSED TO: ENBL
% TIME: 18:10:34
%
% TMDI300 4 FROM: SYS DSBL - SELFTESTS PASSED TO: ENBL
% TIME: 18:10:34
%
% TMDI300 9 FROM: SYS DSBL - SELFTESTS PASSED TO: ENBL
% TIME: 18:10:36
%
% TMDI300 1 FROM: SYS DSBL - SELFTESTS PASSED TO: ENBL
% TIME: 18:10:36
%
% DTA003 2
%
% PRI000 2 5
%
% DTC007 00
%
% DTA021 2
%
% DTC012 0
%
%
% DROL000 DAILY ROUTINE BEGIN
% TDS LD34 BEGIN 18:11 17/6/2014
%
% DTA003 4
%
% PRI000 4 5
%
% DTA005 4
%
% DTA003 1
%
% PRI000 1 5
%
% DTA005 1
%
% DROL001 DAILY ROUTINE END
% TDS LD34 END 18:11 17/6/2014
%
% DROL000 DAILY ROUTINE BEGIN
% CNF LD38 BEGIN 18:11 17/6/2014
%
% DROL001 DAILY ROUTINE END
% CNF LD38 END 18:11 17/6/2014
%
% DROL000 DAILY ROUTINE BEGIN
% AUDIT LD44 BEGIN 18:11 17/6/2014
%
% DTA007 4
%
% DCH054 DCH: 14 EST CONFIRM TIME: 18:11:38 17/06/2014
%
% DCH054 DCH: 14 EST REMOTE TIME: 18:11:38 17/06/2014
%
% DCH055 DCH: 14 RLS REMOTE TIME: 18:11:38 17/06/2014
%
% DCH054 DCH: 14 EST REMOTE TIME: 18:11:38 17/06/2014
%
% DTA003 9
%
% PRI000 9 5
%
% DTA021 9
%
% DTA007 1
%
% DCH054 DCH: 10 EST CONFIRM TIME: 18:11:54 17/06/2014
%
% DCH 10 OMSG RESTART REF 00000000 CH 0 TOD 18:11:54
% TYPE: ALL CHANNEL
%
% DCH054 DCH: 10 EST REMOTE TIME: 18:11:54 17/06/2014
%
% DCH 10 OMSG REST ACK REF 00000000 CH 0 TOD 18:11:54
% TYPE: ALL CHANNEL
%
% DTC103 0
%
%
% DROL001 DAILY ROUTINE END
% AUDIT LD44 END 18:12 17/6/2014
%
% AUD000
%
% DROL000 DAILY ROUTINE BEGIN
% DTIM LD60 BEGIN 18:12 17/6/2014
%
% PRI TRK LOOP 1 ATLP 0
% SLFT OK
% TRSH CNT:
% BPV -000
% SLIPD -000
% SLIPR -000
% CRC -000
% LOSFA -001
% OS_BPV -000
% OS_LOSFA-000
% OS_YEL -001
%
% PRI TRK LOOP 2 ATLP 0
% SLFT OK
% TRSH CNT:
% BPV -000
% SLIPD -000
% SLIPR -000
% CRC -000
% LOSFA -007
% OS_BPV -000
% OS_LOSFA-001
% OS_YEL -000
%
% PRI TRK LOOP 4 ATLP 0
% SLFT OK
% TRSH CNT:
% BPV -000
% SLIPD -000
% SLIPR -000
% CRC -000
% LOSFA -001
% OS_BPV -000
% OS_LOSFA-000
% OS_YEL -001
%
% PRI TRK LOOP 9 ATLP 0
% SLFT OK
% TRSH CNT:
% BPV -000
% SLIPD -000
% SLIPR -000
% CRC -000
% LOSFA -000
% OS_BPV -000
% OS_LOSFA-001
% OS_YEL -000
%
% DROL001 DAILY ROUTINE END
% DTIM LD60 END 18:12 17/6/2014
%
% DROL000 DAILY ROUTINE BEGIN
% CCED LD135 BEGIN 18:12 17/6/2014
%
% DROL001 DAILY ROUTINE END
% CCED LD135 END 18:12 17/6/2014
%
% AUD000
%
% DTA022 9
%
% DTA023 9
%
% DCH: 9 EST CONFIRM TIME: 18:13:54 17/06/2014
%
% AUD000
%
% TIM000 19:00 17/6/2014 CPU 0
%
% AUD000
%
% AUD000
%
% TIM000 20:00 17/6/2014 CPU 0
%
% AUD000
%
% AUD000
%
% TIM000 21:00 17/6/2014 CPU 0
%
% AUD000
%
% AUD000
%
% TIM000 22:00 17/6/2014 CPU 0
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 23:00 17/6/2014 CPU 0
%
% AUD000
%
% AUD000
%
% TIM000 00:00 18/6/2014 CPU 0
%
% AUD000
%
% AUD000
%
% TIM000 01:00 18/6/2014 CPU 0
%
% NPR000 PBXT DONE
%
% DROL001 DAILY ROUTINE END
% NPR LD32 END 01:00 18/6/2014
%
% DROL000 DAILY ROUTINE BEGIN
% TDS LD34 BEGIN 01:00 18/6/2014
%
% DROL001 DAILY ROUTINE END
% TDS LD34 END 01:00 18/6/2014
%
% DROL000 DAILY ROUTINE BEGIN
% CNF LD38 BEGIN 01:00 18/6/2014
%
% DROL001 DAILY ROUTINE END
% CNF LD38 END 01:00 18/6/2014
%
% DROL000 DAILY ROUTINE BEGIN
% AUDIT LD44 BEGIN 01:00 18/6/2014
%
% DROL001 DAILY ROUTINE END
% AUDIT LD44 END 01:00 18/6/2014
%
% AUD000
%
% DROL000 DAILY ROUTINE BEGIN
% DTIM LD60 BEGIN 01:00 18/6/2014
%
% PRI TRK LOOP 1 ATLP 0
% SLFT OK
% TRSH CNT:
% BPV -000
% SLIPD -000
% SLIPR -000
% CRC -000
% LOSFA -000
% OS_BPV -000
% OS_LOSFA-000
% OS_YEL -000
%
% PRI TRK LOOP 2 ATLP 0
% SLFT OK
% TRSH CNT:
% BPV -000
% SLIPD -000
% SLIPR -000
% CRC -000
% LOSFA -873
% OS_BPV -000
% OS_LOSFA-000
% OS_YEL -000
%
% PRI TRK LOOP 4 ATLP 0
% SLFT OK
% TRSH CNT:
% BPV -000
% SLIPD -000
% SLIPR -000
% CRC -000
% LOSFA -000
% OS_BPV -000
% OS_LOSFA-000
% OS_YEL -000
%
% PRI TRK LOOP 9 ATLP 0
% SLFT OK
% TRSH CNT:
% BPV -000
% SLIPD -000
% SLIPR -000
% CRC -000
% LOSFA -000
% OS_BPV -000
% OS_LOSFA-000
% OS_YEL -000
%
% DROL001 DAILY ROUTINE END
% DTIM LD60 END 01:00 18/6/2014
%
% DROL000 DAILY ROUTINE BEGIN
% CCED LD135 BEGIN 01:00 18/6/2014
%
% DROL001 DAILY ROUTINE END
% CCED LD135 END 01:00 18/6/2014
%
% AUD000
%
% AUD000
%
% AUD000
%
% TIM000 02:00 18/6/2014 CPU 0
%
% AUD000
%
% AUD000
%
% TIM000 03:00 18/6/2014 CPU 0
%
% AUD000
%
% AUD000
%
% TIM000 04:00 18/6/2014 CPU 0
%
% AUD000
%
% AUD000
%
% TIM000 05:00 18/6/2014 CPU 0
%
% AUD000
%
% AUD000
%
% TIM000 06:00 18/6/2014 CPU 0
%
% AUD000
%
% AUD000
%
% TIM000 07:00 18/6/2014 CPU 0
%
% AUD000
%
% AUD000
%
% OVL428
%
% TTY #00 LOGGED IN ADMIN1 07:41 18/6/2014
%
% TTY #00 LD 022 ADMIN1 07:41:28 18/6/2014
 
Sort by date Sort by votes
% SYS000 000400 000000 000000 000000 CPU 0

0400 is a power on reset - which means, the main cabinet lost power.
 
Upvote 0 Downvote
The list won't give us much to go on, except to say that it was indeed a full blown Option 11c power reset. Does your system have any kind of UPS installed?.

What concerns me is that the backup was dated 3/6/2014 at 01:00. I'm assuming that this has just happened?. If that is the case, then any changes made on the system since the 3rd June will have been lost.

What I would do now is to log in and go to LD 43 and key in DAT to view the backups and perhaps list them here?.

There might have been some corruption and this caused the switch to reset.
You might also need to get a tech in to go into "pdt", unless you already know how to get the rdtail logs as this would be useful if it shows anything prior to the switch rebooting.


All the best

Firebird Scrambler
Meridian 1 / Succession and BCM / Norstar Programmer in the UK

If it's working, then leave it alone!.
 
Upvote 0 Downvote
Yeah - the main cabinet is on a UPS. It's logs don't show any outages recently. The last outage was feb 4 2014 according to it.
Unfortunatley I can't post the LD 43 printout from down here but it does show main was 3/6/2014 secondary 16/5/2014 Intabackup 3/6/2014 and then it shows an error opening file backup b:/u/ub/config.rec and databse.rec as well. There is not a PCMCIA card in the slots though? I would think there should be one...?
 
Upvote 0 Downvote
Don't worry about the error message backing up to the "B" drive. I'm certain there was a patch to stop that at release 4.0.

If you go into LD 22 and print of the OVLY settings, do you have in DROL 43 listed?. It seems that the Nortel system isn't backup up each night.

All the best

Firebird Scrambler
Meridian 1 / Succession and BCM / Norstar Programmer in the UK

If it's working, then leave it alone!.
 
Upvote 0 Downvote
No - I have DROL 034 038 044 060 135 showing

 
Upvote 0 Downvote
Really! OK, I might be able to handle that! Thanks Firebird!! You the man! Good thing I have you guys to fall back on....I have received excellent help/advice on this forum
 
Upvote 0 Downvote
You know - I wonder why that is not in there now that I think about it? I have worked here for 3 years and this issue has not cropped up before that I know of? I do manually back up stuff when I make changes once in awhile. Maybe I did it often enough to avoid the issue you think? I haven't made any changes at this location in quite awhile......who knows? I still have much to learn on the PBX! Thanks again....
 
Upvote 0 Downvote
Found it!

On a rls 04.00 CS1000 system, after carrying out an EDD or DAT in LD43, TEMU020 messages are produced because the archived database on the pcmcia card (drive B) is not accessible:

TEMU020 Errno 0x380003: Failure opening file b:/u/db/config.rec
TEMU020 Errno 0x380003: Failure opening file b:/u/db/database.rec

patch 20299 prevents these messages being output.

Contact me if you require the patch via the link below.

All the best

Firebird Scrambler
Meridian 1 / Succession and BCM / Norstar Programmer in the UK

If it's working, then leave it alone!.
 
Upvote 0 Downvote
It looks like Loop 2 took a bunch of hits. Not sure if you need all those PRI's (4 that I can see) for a place thats only man'd 10 percent of the time. Sometimes a PRI can Sysload a switch. I would recommend you removing any PRI's that you don't need.
 
Upvote 0 Downvote
Funny thing is that site - when it's in use is 100% staffed and full of bodies. It's our backup site and most likely won't have enough if it goes into a long term situation......I have two carriers of PRI's just in case one is lost. (I think they share the same last mile cable though..? IDK) Not your typical setup for sure. There is one that was abandonned, but I think they left it in the programming for quick turn up if we have to go back. I'll have to dig into that - it hasnt caused me prob's in the past though.

On A side note - I have caught one day in the last week with quite a few sets that were disabled again? I may look inot that power supply to see if I have a spare. Then call a vendor for a deeper look. Evidently there is something much deeper than I know how to look....

Thanks for the inputs!!
 
Upvote 0 Downvote
I'd do a RCNT in LD 60 - and keep an eye on that one PRI with all the lost frames.

Otherwise, everything else looks like it came up fine. The thing with those Option 11c power supplies is you gotta make sure the AC cord is securely plugged in to them as they come up from the bottom. Not the best design in my opinion, but between gravity, hands getting in there, etc...

 
Upvote 0 Downvote
Yeah - I'll see if I catch the PRI and the phones at the same time. The power supply is suspect until I get solid evidence.....
 
Upvote 0 Downvote
Status
Not open for further replies.

Similar threads

Keys09
  • Locked
  • Question
How can I List of ALL DID and extensions associated
Replies
1
Views
208
Firebird Scrambler
Firebird Scrambler
wardy5
  • Locked
  • Question
Norstar/Meridian Cordless Phones
Replies
6
Views
178
Firebird Scrambler
Firebird Scrambler
hotelmotelpatel
  • Locked
  • Question
Accubonder for Nortel 3900 series phones
Replies
0
Views
89
hotelmotelpatel
hotelmotelpatel
ITTech0315
  • Locked
  • Question
Phones Won't Foward to Voice Mail
Replies
19
Views
376
Firebird Scrambler
Firebird Scrambler
bltodd
  • Locked
  • Question
ERR008 Digital and Analog Calls in Hang up after initial connection. Calls to outside hangup Fax too
Replies
0
Views
114
bltodd
bltodd

Part and Inventory Search

Sponsor

Back
Top