Cisco 3550 Switch software crash

[nfordhk]

Our 3550 switch recently crashed hopfully one of you can shed some light why?

IOS: Version 12.2(35)SE5, RELEASE SOFTWARE (fc1)

sh version reports:
System returned to ROM by error - Software Forced Crash Exception (0x0700)!, PC 0x48772C

********#sh stacks
Minimum process stacks:
Free/Size Name
4736/6000 vegas_flash init
3612/6000 SaveCrashBuffer
5740/6000 CDP BLOB
8576/9000 IP Background
5660/6000 vqpc_shim_create_addr_tbl
5644/6000 SPAN Subsystem
7128/12000 Init
8732/9000 cdp init process
5496/6000 RADIUS INITCONFIG
5116/6000 Vegas CrashBuffer
2596/3000 Rom Random Update Process
34996/36000 TCP Command
9344/12000 Virtual Exec

Interrupt level stacks:
Level Called Unused/Size Name
2 2230 8868/9000 Tweetie pwr controller chips
4 6888871 8372/9000 CPU NETWORK INTERFACE CHIP
5 431771 8904/9000 Vegas miami tty xmit hack timer
6 107697963 8936/9000 Clock Timer Vector

Spurious interrupts: 5634

System was restarted by error - Software Forced Crash Exception (0x0700)!, PC 0x48772C
C3550 Software (C3550-IPBASE-M), Version 12.2(35)SE5, RELEASE SOFTWARE (fc1)
Compiled Thu 19-Jul-07 21:08 by nachen (current version)
Image text-base: 0x00003000, data-base: 0x00B06F3C


Stack trace from system failure:
FP: 0x1277860, RA: 0x48772C
FP: 0x1277870, RA: 0x487664
FP: 0x12778D0, RA: 0x4843D8
FP: 0xFFFFFFFF, RA: 0x482800


***************************************************
******* Information of Last System Crash **********
***************************************************


Using flash:/crashinfo/crashinfo_4.
Cisco IOS Software, C3550 Software (C3550-IPBASE-M), Version 12.2(35)SE5, RELEASE SOFTWARE (fc1)
Copyright (c) 1986-2007 by Cisco Systems, Inc.
Compiled Thu 19-Jul-07 21:08 by nachen

Software Forced Crash Exception (0x0700)!
CPU Register Context:
Vector = 0x00000700 PC = 0x0048772C MSR = 0x0002B030 CR = 0x24444024
LR = 0x00487664 CTR = 0x004EF6F0 XER = 0x00000000
R0 = 0x00000000 R1 = 0x01277860 R2 = 0x00000000 R3 = 0x00000000
R4 = 0xFFFFFFFE R5 = 0xFEC0FEC0 R6 = 0xFEE00000 R7 = 0x00003030
R8 = 0x0000B030 R9 = 0x00F30000 R10 = 0x0109C788 R11 = 0x00000000
R12 = 0x1CF5AC50 R13 = 0x351A6DDB R14 = 0x00000000 R15 = 0x00000000
R16 = 0x01114BAC R17 = 0x01114B74 R18 = 0x01110000 R19 = 0x010E0000
R20 = 0x01114BAC R21 = 0x00000000 R22 = 0x01110000 R23 = 0x00000000
R24 = 0x00000000 R25 = 0x01110000 R26 = 0x00000000 R27 = 0x01110000
R28 = 0x00000000 R29 = 0x01110000 R30 = 0x00000000 R31 = 0x00000000

Stack trace:
PC = 0x0048772C, SP = 0x01277860
Frame 00: SP = 0x01277870 PC = 0x00487664
Frame 01: SP = 0x012778D0 PC = 0x004843D8
Frame 02: SP = 0xFFFFFFFF PC = 0x00482800

Our Spurious interrupts is increasing a couple hundred over a few hours. I did not see any console messages pretainnig to watchdog time outs or memory.

.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED: System previously crashed with the following message:
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED: Cisco IOS Software, C3550 Software (C3550-IPBASE-M), Version 12.2(35)SE5, RELEASE SOFTWARE (fc1)
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED: Copyright (c) 1986-2007 by CiscoSystems, Inc.
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED: Compiled Thu 19-Jul-07 21:08 by nachen
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED:
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED: Software Forced Crash Exception (0x0700)!
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED: CPU Register Context:
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED: Vector = 0x00000700 PC = 0x0048772C MSR = 0x0002B030 CR = 0x24444024
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED: LR = 0x00487664 CTR = 0x004EF6F0 XER = 0x00000000
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED: R0 = 0x00000000 R1 = 0x01277860 R2 = 0x00000000 R3 = 0x00000000
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED: R4 = 0xFFFFFFFE R5 = 0xFEC0FEC0 R6 = 0xFEE00000 R7 = 0x00003030
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED: R8 = 0x0000B030 R9 = 0x00F30000 R10 = 0x0109C788 R11 = 0x00000000
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED: R12 = 0x1CF5AC50 R13 = 0x351A6DB R14 = 0x00000000 R15 = 0x00000000
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED: R16 = 0x01114BAC R17 = 0x01114B4 R18 = 0x01110000 R19 = 0x010E0000
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED: R20 = 0x01114BAC R21 = 0x00000000 R22 = 0x01110000 R23 = 0x00000000
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED: R24 = 0x00000000 R25 = 0x01110000 R26 = 0x00000000 R27 = 0x01110000
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED: R28 = 0x00000000 R29 = 0x01110000 R30 = 0x00000000 R31 = 0x00000000
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED:
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED: Stack trace:
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED: PC = 0x0048772C, SP = 0x01277860
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED: Frame 00: SP = 0x01277870 PC = 0x00487664
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED: Frame 01: SP = 0x012778D0 PC = 0x004843D8
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED: Frame 02: SP = 0xFFFFFFFF PC = 0x00482800
.Jun 23 17:07:29: %PLATFORM_CAT3550-1-CRASHED:

 

[vipergg]

You will have to go to the cisco site and put your output into the output interpreter . It was a software crash and this will look for any related bugs in that version of code.

 

[dgrizzard]

There should also be a crashinfo file on the flash that has more information about the software bug. Most of the time you will need to open a TAC request and send this to them to get an answer. You do have an older version of IOS so it may be worth just upgrading, but I would still open a tac for it if you have the ability.