system automatically reboots

[nadeemraja]

hi there,

I have an old vax 4000 system. I m facing the automatic reboot problem. I have extracted the following report from error dump using the command
ANALYZE/ERROR/INCLUDE=(CPU,MEMORY)/SINCE=4-OCT-2004 00:00:00.00/OUT=ER.LIS ERRLOG.SYS;162

this is just a chunk of er.lis, rest of entries are very much similar.

Now i need to know what is the actual problem, is it hardware or software.

I can provide more samples of error dump whic are some what different from the below one.

please help

thanx
nadeem raja

-------------------------------------------------------------
******************************* ENTRY 5495. *******************************
ERROR SEQUENCE 197. LOGGED ON: SID 13000202
DATE/TIME 4-OCT-2004 22:16:28.81 SYS_TYPE 03260B01
SYSTEM UPTIME: 0 DAYS 10:11:28
SCS NODE: WCC VAX/VMS V6.2

MACHINE CHECK KA53 CPU Microcode Rev # 2. CONSOLE FW REV# 2.6
Standard Microcode Patch Patch Rev # 1.

REVISION 00000000
SYSTAT 00000001
ATTEMPTING RECOVERY
FLAGS 00000003
machine check stack frame
KA53 subpacket

STACK FRAME SUBPACKET

ISTATE_1 80060000
MACHINE CHECK FAULT CODE = 06(x)
Current AST level = 4(X)
SYNCHRONOUS HARDWARE ERROR
INT.SYS 00000001
interval timer interrupt enabled
pending software interrupts = 0000(x)
INTERRUPT LEVEL = 00(x)
SAVEPC 87CCEAAC
VA 00000110
Ebox virtual address
Q 00000000
Ebox Q register
ISTATE_2 F0150080
rn = F(X)
vax restart set
opcode inst: BLEQ 15(X)
PSL current mode copy = kernel
PC 87CCEAA9
PSL 04080000
executing on interrupt stack
PSL previous mode = kernel
PSL current mode = kernel
first part done set

KA53 REGISTER SUBPACKET

BPCR ECC80004
PAMODE 00000000
30 bit physical address mode
MMEPTE 898B1E8C
MMESTS 1C00C004
PCSCR 01000200
Patchable control store enabled
standard microcode patch
CPU microcode Patch Rev # = 1.
ICSR 00000001
virtual instruction cache enabled

V A X / V M S SYSTEM ERROR REPORT COMPILED 6-OCT-2004 00:42:58
PAGE 34.

ECR 000000CA
full external interval timer enabled
TBSTS 800001D0
PCCTL FFFFFC13
pcache enabled for D-stream reference
pcache enabled for I-stream reference
pcache parity error detection enabled
PCSTS FFFFF800
CCTL 00000021
backup cache enabled
BCACHE TAG RAM SPEED:
read = 3 cycles, write = 3 cycles
BCACHE DATA RAM SPEED:
read = 2 cycles, write = 3 cycles
512 kilobyte backup cache
BCEDSTS 00000000
BCETSTS 000003E0
MESR 00006000
MMCDSR 09AF2400
2600 cycles before disown write tmeout
enable logging soft errors
CQBIC on CP_I02
CESR 80040200
CP2 IO Error
NDAL Interrupt Vector Read Timeout
Error Summary
CMCDSR 0000C108
DMA prefetching enabled
3200 Cycles Before NDAL Timeout
144 cycles before cp1 mt timeout
144000 cycles before cp2 mt timeout
cp1 interrupts pending:
none
cp2 interrupts pending:
none
CEFSTS 0001920A
LOCK SET
FILL FAILED DUE TO READ DATA ERROR
data to be returned to mbox
do not fill
count = 3.
NESTS 00000000
NEOCMD 8000F005
NEICMD 00000100
DSER 00000080
Q-22 Bus NXM
MMEADR 00004607
VMAR 000007E0
TBADR 00000000
PCADR FFFFFFF8
BCEDIDX 00004440
BCEDECC 00000000
BCETIDX 80101000
BCETAG FFFFFE00
MEAR 08406010
MOAMR 00000000

V A X / V M S SYSTEM ERROR REPORT COMPILED 6-OCT-2004 00:42:58
PAGE 35.


CSEAR1 00000000
CSEAR2 00000000
CIOEAR1 0000405C
CIOEAR2 00000804
CP2 IO Error Address = 20000804
NDAL Commander ID (CP2 transac) = 0(X)
CNEAR 00000000
CEFADR E0000800
CBOX fill error address
NEOADR 03D8A9C0
NEDATHI 00000000
NEDATLO 00000000
QBEAR 00000004
Q-22 Bus Page Err Address
17770000(O)
20000800(X)
DEAR 00000000
IPCR0 0020
Local Memory External Access Enabled
------------------------------------------------------------

 

[WillemGrooters]

If this happens all of a sudden, without chnages to VMS or applications, it's quite likely some hardware error. That's shown as well:

STACK FRAME SUBPACKET

ISTATE_1 80060000
MACHINE CHECK FAULT CODE = 06(x)
Current AST level = 4(X)
SYNCHRONOUS HARDWARE ERROR <<------

Just a suggestion: Put your question on HP ITRC's OpenVMS Forum. If you don't want to register, I'm willing to do that on your behalf.




Willem Grooters
OpenVMS Developer and System Manager
w:

http://www.grootersnet.nl

 

[nadeemraja]

yes, it happens all of a sudden. I watched the behaviour of the system about 18 hours contineously but it did not happen but when i was expecting that it will not reboot again, it suddenly rebooted twice with in 15 minutes today 06-oct-2004 again.
I will be highly obliged if u can put it on ITRC's forum for me.

thanx
nadeem raja

 

[nadeemraja]

yes it happens all of a sudden. today it rebooted twice with in 15 minutes.
I will be highly obliged if u can put it on ITRC's forum for me.

thanx

nadeem raja

 

[nadeemraja]

please find below the latest error report which was generated today.
further i would like to tell u about what changes our hardware engineers has done so far.
1. we changed the lpv11 cards
2. we have changed the dhv11 cards
3. we have changed the vax 4000 system with another one
4. keep in mind that we are using the micro vax 2 system for lpv11 and dhv11 cards
5. we have changed the ram modules also
6. we have tried running vax 4000 independently, i mean without joining it with micro vax 2 system

but still the problem exists.

i will be highly obliged if someone can guide in this regards, specially telling us whether it is due to hardware or some softeware problem.

any suggestion in this regards are welcome.

any further clarification, if required, will b promptly submitted.

thanks in advance

nadeem raja


error text:----- follows
---------------------------------------------------------

V A X / V M S SYSTEM ERROR REPORT COMPILED 7-OCT-2004 09:56:54
PAGE 1.

******************************* ENTRY 180. *******************************
ERROR SEQUENCE 74. LOGGED ON: SID 13000202
DATE/TIME 7-OCT-2004 08:13:30.06 SYS_TYPE 03260B01
SYSTEM UPTIME: 0 DAYS 00:13:30
SCS NODE: WCC VAX/VMS V6.2

INT60 ERROR KA53 CPU Microcode Rev # 2. CONSOLE FW REV# 2.6
Standard Microcode Patch Patch Rev # 1.

REVISION 00000000
SYSTAT 00000000
FLAGS 00000002
KA53 subpacket

KA53 REGISTER SUBPACKET

BPCR ECC80001
PAMODE 00000000
30 bit physical address mode
MMEPTE 857CA27C
MMESTS 1C008004
PCSCR 01000200
Patchable control store enabled
standard microcode patch
CPU microcode Patch Rev # = 1.
ICSR 00000001
virtual instruction cache enabled
ECR 0000008A
full external interval timer enabled
TBSTS 800001D0
PCCTL FFFFFC13
pcache enabled for D-stream reference
pcache enabled for I-stream reference
pcache parity error detection enabled
PCSTS FFFFF800
CCTL 00000021
backup cache enabled
BCACHE TAG RAM SPEED:
read = 3 cycles, write = 3 cycles
BCACHE DATA RAM SPEED:
read = 2 cycles, write = 3 cycles
512 kilobyte backup cache
BCEDSTS 00000000
BCETSTS 000003E0
MESR 00006000
MMCDSR 09AF2400
2600 cycles before disown write tmeout
enable logging soft errors
CQBIC on CP_I02
CESR 00000000
CMCDSR 0000C108
DMA prefetching enabled
3200 Cycles Before NDAL Timeout
144 cycles before cp1 mt timeout
144000 cycles before cp2 mt timeout
cp1 interrupts pending:

V A X / V M S SYSTEM ERROR REPORT COMPILED 7-OCT-2004 09:56:54
PAGE 2.

none
cp2 interrupts pending:
none
CEFSTS 00019200
NESTS 00000000
NEOCMD 8000F005
NEICMD 00000108
DSER 00000080
Q-22 Bus NXM
MMEADR 00193E00
VMAR 000007E0
TBADR 00000000
PCADR FFFFFFF8
BCEDIDX 000754C0
BCEDECC 00000000
BCETIDX 80189000
BCETAG 00000000
MEAR 08406010
MOAMR 00000000

CSEAR1 00000000
CSEAR2 00000000
CIOEAR1 0000405C
CIOEAR2 00000340
CNEAR 00000000
CEFADR E0000340
NEOADR E1020018
NEDATHI 00000000
NEDATLO 00000000
QBEAR 00000004
Q-22 Bus Page Err Address
17770000(O)
20000800(X)
DEAR 00000000
IPCR0 0020
Local Memory External Access Enabled

V A X / V M S SYSTEM ERROR REPORT COMPILED 7-OCT-2004 09:56:54
PAGE 3.

******************************* ENTRY 188. *******************************
ERROR SEQUENCE 82. LOGGED ON: SID 13000202
DATE/TIME 7-OCT-2004 08:19:28.18 SYS_TYPE 03260B01
SYSTEM UPTIME: 0 DAYS 00:04:41
SCS NODE: WCC VAX/VMS V6.2

INT60 ERROR KA53 CPU Microcode Rev # 2. CONSOLE FW REV# 2.6
Standard Microcode Patch Patch Rev # 1.

REVISION 00000000
SYSTAT 00000000
FLAGS 00000002
KA53 subpacket

KA53 REGISTER SUBPACKET

BPCR ECC80000
PAMODE 00000000
30 bit physical address mode
MMEPTE 03E60344
MMESTS 1C00C004
PCSCR 01000200
Patchable control store enabled
standard microcode patch
CPU microcode Patch Rev # = 1.
ICSR 00000001
virtual instruction cache enabled
ECR 000000CA
full external interval timer enabled
TBSTS 800001D0
PCCTL FFFFFC13
pcache enabled for D-stream reference
pcache enabled for I-stream reference
pcache parity error detection enabled
PCSTS FFFFF800
CCTL 00000021
backup cache enabled
BCACHE TAG RAM SPEED:
read = 3 cycles, write = 3 cycles
BCACHE DATA RAM SPEED:
read = 2 cycles, write = 3 cycles
512 kilobyte backup cache
BCEDSTS 00000000
BCETSTS 000003E0
MESR 00006000
MMCDSR 09BD2A00
2600 cycles before disown write tmeout
enable logging soft errors
CQBIC on CP_I02
CESR 00000000
CMCDSR 0000C108
DMA prefetching enabled
3200 Cycles Before NDAL Timeout
144 cycles before cp1 mt timeout
144000 cycles before cp2 mt timeout
cp1 interrupts pending:

V A X / V M S SYSTEM ERROR REPORT COMPILED 7-OCT-2004 09:56:54
PAGE 4.

none
cp2 interrupts pending:
none
CEFSTS 00019200
NESTS 00000000
NEOCMD 8000F005
NEICMD 00000108
DSER 00000088
Lost Error
Q-22 Bus NXM
MMEADR 81C2A208
VMAR 000007E0
TBADR 00000000
PCADR FFFFFFF8
BCEDIDX 000754C0
BCEDECC 00000000
BCETIDX 80189000
BCETAG 00000000
MEAR 08406010
MOAMR 00000000

CSEAR1 00000000
CSEAR2 00000000
CIOEAR1 0000405C
CIOEAR2 00000340
CNEAR 00000000
CEFADR E0000340
NEOADR E1020018
NEDATHI 00000000
NEDATLO 00000000
QBEAR 00000004
Q-22 Bus Page Err Address
17770000(O)
20000800(X)
DEAR 00000000
IPCR0 0020
Local Memory External Access Enabled

V A X / V M S SYSTEM ERROR REPORT COMPILED 7-OCT-2004 09:56:54
PAGE 5.

******************************* ENTRY 196. *******************************
ERROR SEQUENCE 90. LOGGED ON: SID 13000202
DATE/TIME 7-OCT-2004 08:27:27.94 SYS_TYPE 03260B01
SYSTEM UPTIME: 0 DAYS 00:04:17
SCS NODE: WCC VAX/VMS V6.2

INT60 ERROR KA53 CPU Microcode Rev # 2. CONSOLE FW REV# 2.6
Standard Microcode Patch Patch Rev # 1.

REVISION 00000000
SYSTAT 00000000
FLAGS 00000002
KA53 subpacket

KA53 REGISTER SUBPACKET

BPCR ECC8000F
PAMODE 00000000
30 bit physical address mode
MMEPTE 03E8C6B8
MMESTS 18008000
PCSCR 01000200
Patchable control store enabled
standard microcode patch
CPU microcode Patch Rev # = 1.
ICSR 00000001
virtual instruction cache enabled
ECR 0000008A
full external interval timer enabled
TBSTS 800001D0
PCCTL FFFFFC13
pcache enabled for D-stream reference
pcache enabled for I-stream reference
pcache parity error detection enabled
PCSTS FFFFF800
CCTL 00000021
backup cache enabled
BCACHE TAG RAM SPEED:
read = 3 cycles, write = 3 cycles
BCACHE DATA RAM SPEED:
read = 2 cycles, write = 3 cycles
512 kilobyte backup cache
BCEDSTS 00000000
BCETSTS 000003E0
MESR 00006000
MMCDSR 08B14E00
2600 cycles before disown write tmeout
enable logging soft errors
CQBIC on CP_I02
CESR 00000000
CMCDSR 0000C108
DMA prefetching enabled
3200 Cycles Before NDAL Timeout
144 cycles before cp1 mt timeout
144000 cycles before cp2 mt timeout
cp1 interrupts pending:

V A X / V M S SYSTEM ERROR REPORT COMPILED 7-OCT-2004 09:56:54
PAGE 6.

none
cp2 interrupts pending:
none
CEFSTS 00019200
NESTS 00000000
NEOCMD 00000F04
NEICMD 00000108
DSER 00000080
Q-22 Bus NXM
MMEADR 83245D18
VMAR 000007E0
TBADR 00000000
PCADR FFFFFFF8
BCEDIDX 000754C0
BCEDECC 00000000
BCETIDX 80189000
BCETAG 00000000
MEAR 08406010
MOAMR 00000000

CSEAR1 00000000
CSEAR2 00000000
CIOEAR1 0000405C
CIOEAR2 00000340
CNEAR 00000000
CEFADR E0000340
NEOADR E1020018
NEDATHI 00000000
NEDATLO 00000000
QBEAR 0000000F
Q-22 Bus Page Err Address
17776000(O)
20001E00(X)
DEAR 00000000
IPCR0 0020
Local Memory External Access Enabled
ANAL/ERROR/INCLUDE=(CPU,MEM)/SINCE=7-OCT-2004 00:00:00.00/OUT=07102004.ERR
------------------------------------------------------