When using VERITAS NetBackup 3.4.x on Solaris 8 (64 bit only), using VERITAS File System (tm) or UNIX File System, the backup operation completes with error Status 1, with the errors in the bpbkar log.
Exact Error Message
file xxx shrunk by x bytes padding with zeros
Details:
During a backup operation, files are reported to be padded with zeros by NetBackup. The files can become corrupted. Client compression is disabled.
Extract from the bpbkar log:
2/9/01 hfxcdb4 22360 0 0 caprd bpbrm from client caprd: ERR- File /u22/oradata/db9888/IMAGES012_04.dbf shrunk by 2203276800 bytes, padding with zeros (R/0)
4/9/01 hfxcdb4 22991 0 0 caprd bpbrm from client caprd: ERR - File /u11/oradata/db9888/IMAGES025_03.dbf shrunk by 662074880 bytes, padding with zeros (R/W)
hfxcdb4 23001 0 0 caprd bpbrm from client caprd: ERR - File /u29/oradata/db9888/arch/ARC0000260502.LOG shrunk by 5861376 bytes, padding with zeros (ARCH)
hfxcdb4 bpbrm from client hfxcdb4: ERR - File /var/sadm/pkg/SUNWxwplt/save/108652-18/undo.Z shrunk by 1298593 bytes, padding with zeros (Non DB)
10/9/01 hfxcdb4 24280 0 0 caprd bpbrm from client caprd: ERR - File /u11/oradata/db9888/IMAGES025_01.dbf shrunk by 11768188416 bytes, padding with zeros (R/W)
The resulting backup will fail with status one and the files will be corrupted.
This issue is related to Sun BugID #4502769 with asynchronous IO on Solaris 8 - 64 bit, the Sun posix4 aio implementation. The problem is due to a bug in the libaio binary in Solaris, which can, for example in the case of NetBackup 3.4, cause the backup to think Solaris has finished reading file data when in fact it has not.
The NetBackup workaround before the Sun patch release was to disable asynchronous I/O for NetBackup. This was done by creating the file /usr/openv/netbackup/AIO_READS_MAX. Place a value of 1 in the file to turn off asynchronous I/O. This can impact the speed of the backups and may require tuning until the Sun patch can be applied.
On Sun Solaris 8 (64 bit) platforms, apply Sun patch 109384-03 or later to fix Sun Bug # 4502769 that causes this issue with "file xxx shrunk by x bytes padding with zeros." If Sun patch 109384-03 or later is applied and the NetBackup workaround in this TechNote is being used, delete the /usr/openv/netbackup/AIO_READS_MAX file.
To obtain this patch, contact Sun:
Worldwide Sun support numbers:
Obtain Sun patches and patch details:
Bob Stump
Just because the VERITAS documentation states something as certain, that does not make it a fact and that is truth.