Strange 2008 R2 behavior

[djj55]

Hello I have a problem where a memory dump starts and repeats until the system is no longer responding.

[tt]2010-09-07 00:01:00.30 spid68 DBCC TRACEON 3226, server process ID (SPID) 68. This is an informational message only; no user action is required.
2010-09-07 03:00:34.02 spid59
Memory Manager KB
---------------------------------------- ----------
VM Reserved 10616976
VM Committed 10597536
Locked Pages Allocated 0
[/tt]
This goes through the current (non system) spid's and starts again, over and over.

No error just the memory dump.

Any suggestions?

Thank you,

djj
The Lord is my shepherd (Psalm 23) - I need someone to lead me!

 

[mrdenny]

Turn off trace flag 3226.

Denny
MVP
MCSA (2003) / MCDBA (SQL 2000)
MCTS (SQL 2005 / SQL 2005 BI / SQL 2008 DBA / SQL 2008 DBD / SQL 2008 BI / MWSS 3.0: Configuration / MOSS 2007: Configuration)
MCITP (SQL 2005 DBA / SQL 2008 DBA / SQL 2005 DBD / SQL 2008 DBD / SQL 2005 BI / SQL 2008 BI)

My Blog

 

[djj55]

At 12:01 AM I run DBCC TRACEON (3226, -1) which I thought turned off 3226.
The problem did not start until 3 am.

djj
The Lord is my shepherd (Psalm 23) - I need someone to lead me!

 

[mrdenny]

Nope that would be DBCC TRACEOFF (3226, -1) to turn it off.

Denny
MVP
MCSA (2003) / MCDBA (SQL 2000)
MCTS (SQL 2005 / SQL 2005 BI / SQL 2008 DBA / SQL 2008 DBD / SQL 2008 BI / MWSS 3.0: Configuration / MOSS 2007: Configuration)
MCITP (SQL 2005 DBA / SQL 2008 DBA / SQL 2005 DBD / SQL 2008 DBD / SQL 2005 BI / SQL 2008 BI)

My Blog

 

[djj55]

Thanks! I had a bad day when I set that up and thought it was odd that you used TRACEON to turn it off but thought I read I needed to do it that way.

Thanks again,

djj
The Lord is my shepherd (Psalm 23) - I need someone to lead me!

 

[djj55]

Well I started using the TRACEOFF last week but it dumped again last night.

Note that I set TRACEOFF at midnight while the dump did not happen until 4:32 AM

The log shows the Log Shipping, transaction log file back ups then it just starts the memory dump.

On the Windows 2008 R2 server side at 2:49 I got
[tt]Faulting application name: wmiprvse.exe, version: 6.1.7600.16385, time stamp: 0x4a5bc794
Faulting module name: ole32.dll, version: 6.1.7600.16385, time stamp: 0x4a5be01a
Exception code: 0xc0000005
Fault offset: 0x0000000000039389
Faulting process id: 0xca8
Faulting application start time: 0x01cb59c74be900e1
Faulting application path: C:\Windows\system32\wbem\wmiprvse.exe
Faulting module path: C:\Windows\system32\ole32.dll
[/tt]

At 4:35 it shows
[tt]Error: 17887, Severity: 10, State: 1. (Params. The error is printed in terse mode because there was error during formatting. Tracing, ETW, notifications etc are skipped.[/tt]

Any thoughts?

Thank you,

djj
The Lord is my shepherd (Psalm 23) - I need someone to lead me!

 

[mrdenny]

That error was thrown by WMI. You'll want to make sure that the OS is fully patched.

Denny
MVP
MCSA (2003) / MCDBA (SQL 2000)
MCTS (SQL 2005 / SQL 2005 BI / SQL 2008 DBA / SQL 2008 DBD / SQL 2008 BI / MWSS 3.0: Configuration / MOSS 2007: Configuration)
MCITP (SQL 2005 DBA / SQL 2008 DBA / SQL 2005 DBD / SQL 2008 DBD / SQL 2005 BI / SQL 2008 BI)

My Blog

 

[djj55]

Thank you, I will look into that. I do know we do not have the latest as the proxy stopped the download this past weekend (new firewall), but we are not far out-of-date. Anyway, I will try again this weekend.

Thanks again,

djj
The Lord is my shepherd (Psalm 23) - I need someone to lead me!

 

[djj55]

I notice there are three hot fixes for SQL Server 2008 R2. The first one talks about a memory leak.

Would this be something to try?

Thank you,

djj
The Lord is my shepherd (Psalm 23) - I need someone to lead me!

 

[mrdenny]

It couldn't hurt.

Denny
MVP
MCSA (2003) / MCDBA (SQL 2000)
MCTS (SQL 2005 / SQL 2005 BI / SQL 2008 DBA / SQL 2008 DBD / SQL 2008 BI / MWSS 3.0: Configuration / MOSS 2007: Configuration)
MCITP (SQL 2005 DBA / SQL 2008 DBA / SQL 2005 DBD / SQL 2008 DBD / SQL 2005 BI / SQL 2008 BI)

My Blog

 

[djj55]

With Microsoft you never know. I have "fixed" things, then had to delete and reinstall.

djj
The Lord is my shepherd (Psalm 23) - I need someone to lead me!

 

[djj55]

Hello,
My system guy came up with a possible fix. It was for Windows Server 2008 R2 not SQL server but it seems to have (for now) solved the problem.

Here is a portion of his email to our manager.
[tt]Its sort of an educated shot in the dark on whether or not it will fix our problems,
but we've really got nothing else to go on at the moment and it seems that this
problem is consistently becoming a bigger issue.
The knowledge base article that details this hotfix and the problem is KB981314
and the link is below if you'd like to take a look.
There are a few other hotfixes that I'm researching as well,
but I dont feel as strongly about them. The one chosen seems like it may relate
to our problems because we have been seeing a few wmiprsvc.exe errors in the
app logs on the windows server, saying that the service is crashing.
Just wanted to give you a heads up on whats going on.

http://support.microsoft.com/kb/981314

[/tt]

djj
The Lord is my shepherd (Psalm 23) - I need someone to lead me!