My issue is I have around 40 million small tiff files on our production NAS server. It totals to around 4.4 terabytes. The backup using Networker 7.2 and an IBM 3583 library with an IBM 3580 LTO3 tape drive takes around 40 hours for a full backup.
I'm pretty sure this is due to the millions of tiny files and the fact that when the LTO3 drive slows below 40mb a sec it stops and you get the whole head repositioning issue.
The Legato server is Win2k3 HP-DL380 G2. The link speed is 1 gbps and it is %27 utilized. I've checked the disk and memory usage on the client box and those stats are fine. The CPU on the client (dual proc compaq B2000 NAS G2) are getting hammered and staying around %90 with 8 save streams running.
I divided up the nas and did some tests. When I run a backup on 60 files that total 600 gig I get 40mb + per sec. If I run a backup on one of the directories with 5 million small tif files that total 218 gig I get 6-7 mb per sec.
Would a file device to stage pool backup actually improve performance enough? I'm trying to get them to purchase more tape drives as that would help. Can you think of any other ideas.
I'm pretty sure this is due to the millions of tiny files and the fact that when the LTO3 drive slows below 40mb a sec it stops and you get the whole head repositioning issue.
The Legato server is Win2k3 HP-DL380 G2. The link speed is 1 gbps and it is %27 utilized. I've checked the disk and memory usage on the client box and those stats are fine. The CPU on the client (dual proc compaq B2000 NAS G2) are getting hammered and staying around %90 with 8 save streams running.
I divided up the nas and did some tests. When I run a backup on 60 files that total 600 gig I get 40mb + per sec. If I run a backup on one of the directories with 5 million small tif files that total 218 gig I get 6-7 mb per sec.
Would a file device to stage pool backup actually improve performance enough? I'm trying to get them to purchase more tape drives as that would help. Can you think of any other ideas.