Backups failing with 2 drives Arcserve r12.0 SP2

[bmartinuzzi]

Hello everyone,

I am coming to you today asking for help, as CA has been unable to find a solution for me (so far). I have been using a single tape drive (1 quantum PX502 library, 1 tape drive) and Arcserve for some time. Our backup windows have grown so much, we now need a second drive. We purchased a second drive from Quantum (same as the first) and installed it into our existing library (1 library, 2 drives). I made sure to update the firmware on both drives to the same level (as suggested in other posts on here), as well as the firmware on the library, and made sure Arcserve was on the latest patches. I have a number of backup jobs that are failing, and there does not seem to be any pattern to the failing. They will be successful sometimes, fail others.

Here is the error messages I am getting in the job log:

11/2/2009 12:47:14 PM E3719 Unable to write to media. (MEDIA=11/02/09 12:46 PM [S/N: MSQ525L3], EC=COMMAND ABORTED)
11/2/2009 12:47:15 PM E3712 Unable to close session. (EC=COMMAND ABORTED)


When I go to the tape log, here is what I am finding:


[11/02 12:47:06 175c 2 BK 11677 11678 6] DYNAMICALLY SHARED SAN DEVICE -> FALSE
[11/02 12:47:06 175c 2 BK 11677 11678 6] OPTIMAL DEVICE HANDLE -> ADDRESS[0x004D39A0]
[11/02 12:47:07 13d8 2 BK 11677 11678 6] MEM: Total Physical Memory 2145312768
[11/02 12:47:07 13d8 2 BK 11677 11678 6] MEM: Avail Physical Memory 1184149504
[11/02 12:47:07 13d8 2 BK 11677 11678 6] MEM: Avail Page File -1302478848
[11/02 12:47:07 13d8 2 BK 11677 11678 6] MEM: Total Avail memory -118329344
[11/02 12:47:07 13d8 2 BK 11677 11678 6] MEM: Total Buffers returned 2048, 32768 KB
[11/02 12:47:07 13d8 2 BK 11677 11678 6] DRV:1 Daemon chuncks to use:2048 for JobID[11678]
[11/02 12:47:07 13d8 2 BK 11677 11678 6] CreateSharedMem(): Connection Type [4]
[11/02 12:47:07 13d8 2 BK 11677 11678 6] AllocateLocalSharedMemory(): Create share memory Global\ARC_SM_11678_1_1_3 successfully
[11/02 12:47:07 13d8 2 BK 11677 11678 6] DRV:1 ReadShots:4
[11/02 12:47:07 13d8 2 BK 11677 11678 6] DRV:1 WriteShots:4
[11/02 12:47:07 13d8 2 BK 11677 11678 6] DRV:1 WriteDeamon thread created TID[16a8]
[11/02 12:47:07 13d8 2 BK 11677 11678 6] =>ABSL:3010 [WRITE ] Logging *DISABLED*
[11/02 12:47:07 16a8 1 WD 11677 11678 6] Transfer Length to TapeEngine:[64]KB
[11/02 12:47:13 16a8 1 WD 11677 11678 6] UnExpected SCSI Error ==> JobID[11677], Device[1], ABSL[3 0 1 0], SN[HU10618N71], CMD[ah], [Insufficient Resources], ASC[47], ASCQ[03]
[11/02 12:47:13 16a8 2 WD 11677 11678 6] 12:47:13 =>ABSL:3010 [WRITE ] 0a 01 00 00 01 00 00 00 00 00
[11/02 12:47:13 16a8 2 WD 11677 11678 6] =>ABSL:3010 [REQUEST SENSE ] 03 00 00 00 40 00 00 00 00 00
[11/02 12:47:13 16a8 2 WD 11677 11678 6] <WRITE >, Sense Data as Follows:
[11/02 12:47:13 16a8 2 WD 11677 11678 6] SENSE ABSL:3010 70 00 0b 00 00 00 00 10 00 00 00 00 47
[11/02 12:47:13 16a8 2 WD 11677 11678 6] EX SENSE ABSL:3010 03 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[11/02 12:47:13 16a8 2 WD 11677 11678 6] SENSE ABSL:3010 Command Aborted [0b]
[11/02 12:47:13 16a8 2 WD 11677 11678 6] EX SENSE ABSL:3010 Insufficient Resources [47, 03]
[11/02 12:47:13 16a8 2 WD 11677 11678 6] WriteDaemon::Hardware Error Hits!!!
[11/02 12:47:13 16a8 2 WD 11677 11678 6] WriteDaemon: daemonStatus= [0xad]
[11/02 12:47:13 16a8 2 WD 11677 11678 6] =>ABSL:3010 WriteDaemon thread suspended. DaemonStatus[ad]
[11/02 12:47:14 13d8 2 BK 11677 11678 6] LDN:1 End Session for hJob[022396DC]
[11/02 12:47:15 16a8 2 WD 11677 11678 6] =>ABSL:3010 WriteDaemon thread resumed.
[11/02 12:47:15 13d8 2 BK 11677 11678 6] Call FreeSharedMemory(jobid=11678,dcb=1,sesid=0)...
[11/02 12:47:15 13d8 2 BK 11677 11678 6] FreeSharedMemory(): Release share memory successfully
[11/02 12:47:15 13d8 2 BK 11677 11678 6] =>ABSL:3010 [LOG SENSE ] 4d 00 71 00 00 00 00 00 20 00 tt[5]
[11/02 12:47:15 13d8 2 BK 11677 11678 6] DRV:1 Tape Maximum Capacity:400308 MB
[11/02 12:47:15 13d8 2 BK 11677 11678 6] DRV:1 Tape Remaining Capacity:400252 MB
[11/02 12:47:15 0584 2 BK 11677 11678 6] =>ABSL:3010 [LOG SENSE ] 4d 00 72 00 00 00 00 00 4c 00 tt[5]
[11/02 12:47:15 0584 2 BK 11677 11678 6] DRV:1 (KB Wrote to host:196299) (KB Wrote to Tape:59392)
[11/02 12:47:15 0584 2 BK 11677 11678 6] DRV:1 ClientGetCompressionRatio: 0.470000
[11/02 12:47:15 13d8 2 ] DestroyJobHandle[022396DC]
[11/02 12:47:15 13d8 2 ] ACTIVEJ: Failed to CreateFileMapping MS=1006 in ClearJCBConfiguration() for hJob[022396DC]
[11/02 12:47:15 13d8 2 ] Destroy JobID[11678]: Active Jobs now: [6] -- jID[11678], mID[0], jTKN[0], dcb[1]
[11/02 12:47:16 175c 2 BK 11677 5] Entering EnumTapeName() State:[1]. TapeName[11/02/09 12:46 PM] RID[4e80] SQ [1]
[11/02 12:47:16 175c 2 BK 11677 5] ClientEnumTapeOpen(): TapeName [11/02/09 12:46 PM], RID [4e80], Seq [1], SelectionFlag [0x100], JobFlag [0x00008001], DontCheckMediaInUse [0]
[11/02 12:47:16 175c 2 BK 11677 5] ClientEnumTapeOpen: Detected TSI_ETSF_EXPORT, setting bDontCheckMediaInUse to TRUE.
[11/02 12:47:16 175c 2 BK 11677 5] SelectionFlag[0x03] Name[11/02/09 12:46 PM] RandomID[4E80] SequenceNo[1].
[11/02 12:47:16 175c 2 BK 11677 5] <Enum on TAPE NAME & RANDOM ID>


I have tried swapping the new SCSI cable that I added with the second drive, devices (library, and both tape drives) are disabled within device manager, Windows removable storage service is disabled.



If anyone can provide any insight as to what is happening, or can suggest I try anything, please let me know.

Thank you

 

[fabio9]

ehr...if you opened an issue and the c.a. is not (still?) able to find a solution...:-((

Just guessing but...is your quantum PX502 library in the compatibility matrix ?

 

[bmartinuzzi]

I have been talking to either CA or Quantum for a better part of 2 weeks now. Origionally CA said it was a hardware issue. I spoke with Quantum and ran every test they advised, and then some. All tests passed.

I have been using the PX502 with a single drive for a number of years without problem. CA has not said anything to me about known compatibility issues.

 

[davidmichel]

I doubt it will help but worth a try anyways.

http://support.microsoft.com/kb/304101

Beyond that I also say hardware.

Forget about diagnostics and swap components.
Terminator, cable, controller, drive.

The library should be the only thing on the bus, if not set it up that way and then test it.

For something like this, how you engage hardware support is important. Forget about "there is a problem with the library" don't even go there.

Instead the drive is failing to Write data, reporting this back to the application.
11/02 12:47:13 16a8 2 WD 11677 11678 6] SENSE ABSL:3010 Command Aborted [0b]
[11/02 12:47:13 16a8 2 WD 11677 11678 6] EX SENSE ABSL:3010 Insufficient Resources [47, 03]

Why is the tape device doing this?

Now at that point who cares if it passes diagnostics, that's not what you asked, they need to answer why the tape drive is reporting those sense codes.

Oh, also check to see if it is both tape drives, perchance it is only one. At that point it is either a problem with the other drive or the cabling internal to the library to that drive.

You can tell the drive via the ABSL - Adapter Bus SCSI ID LUN.