Disk Operation Error

[KOG]

Hi folks,

I always run errpt first thing in the morning before checking oracle alert log for any errors reported. And I got this error report about hard disk5 which contains both oracle backups and rollback datafile.

$ errpt
IDENTIFIER TIMESTAMP T C RESOURCE_NAME DESCRIPTION
8BDD5B42 0628190202 T H pdisk5 DISK OPERATION ERROR

Ran errpt -a to get details of the error message.
---------------------------------------------------------------------------
LABEL: SSA_DISK_ERR3
IDENTIFIER: 8BDD5B42

Date/Time: Fri 28 Jun 19:02:08
Sequence Number: 2
Machine Id: 0009D84CA100
Node Id: blbrs580
Class: H
Type: TEMP
Resource Name: pdisk5
Resource Class: pdisk
Resource Type: 4000mbC
Location: 00-01-P
VPD:
Manufacturer................IBM
Machine Type and Model......DFHCC4B1
Part Number.................89H4941
ROS Level and ID............9590
Serial Number...............68077DEE
EC Level....................488651
Device Specific.(Z2)........RAMSC095
Device Specific.(Z3)........89H4941
Device Specific.(Z4)........97098

Description
DISK OPERATION ERROR

Probable Causes
DASD MEDIA

Failure Causes
DASD MEDIA

Recommended Actions
PERFORM PROBLEM DETERMINATION PROCEDURES

Detail Data
SENSE DATA
F000 0100 098B 6A18 0000 0000 1603 0080 0011 0000 01D1 0000 0186 07B1 00B1 0000

Any idea the reason for this error message, is it hardware problem or bad data block?

We had a disk corruption last March and I do not want to see this event repeating itself. It took two days to bring the system back up running.

Thanking you all in advance.

Regards

Katherine

 

[KenCunningham]

Katherine, as a first step, try running fsck against the filesystems mounted on the disk. Post back with any results. I'd suggest running fsck -n first (see the man pages for fsck) so that you're sure that no changes will take place that you might not want. In addition, if possible, back up all data on the drive. Good luck.

 

[AIXSPadmin]

SSA_DISK_ERR3 is a temporary disk operation error and was a recovered SSA disk media error.

If you do run an fsck, you should have the filesystems unmounted; if they are mounted write will be supressed because you don't want to write changes to a mounted filesystem.

 

[KOG]

HI AIXSPadmin,

I am not sure what fsck does and I do not want to unmount this filesystem as it is the filesystem that stores daily backups. Space is limit on our server and we are in the progress of migrating to new server F50 shortly.

I am doing daily backups and making copies of the backups across network to be on safe side.

Regards

Katherine

 

[AIXSPadmin]

Katherine,

fsck checks filesystem integrity and interactively repairs it.

Backups are always a good idea, and unfortunately necessary; we have a full-time backup person who does nothing but check our daily incrementals and weekly full backups on our 73 SP nodes. We have needed to restore in the past from mksysb's and also do restores from our daily TSM backups.

F50s are nice, we have 3 of them and an F40 (but F40s don't support fibre) so we are running 6 internal disks. But F50s do support fibre, don't know if that is what you are using, but just thought I would mention it.

I know what limited disk space is like. We have one server that has about a terabyte attached to it and we are short of space on that server, and we don't have much DASD we can get from storage because they don't have much to allocate.

 

[Yegolev]

You should be able to umount the backup fs as long as you mount it again before the backup kicks off.

Another thing to do is run `diag` and go into Task Selection then SSA Service Aids or something like that and see what you see. You can also run ELA (Error Log Analysis) from the diag menu and it will attempt to decipher the errpt for you. IBM Certified -- AIX 4.3 Obfuscation