Tek-Tips is the largest IT community on the Internet today!

Members share and learn making Tek-Tips Forums the best source of peer-reviewed technical information on the Internet!

  • Congratulations Andrzejek on being selected by the Tek-Tips community for having the most helpful posts in the forums last week. Way to Go!

Storing lot of files

Status
Not open for further replies.

lardum

IS-IT--Management
Apr 26, 2000
462
SE
I have a windows 2003 server as a file server.

I have about 400.000 small files (about 1Kb each) in one directory. I'm having major problems backing up this folder.

Anyone have any suggestions on what to do?
 
What are the major problems you are having?? Error messages, what backup software you are using or have tried, anyhting in the event logs??

Paul
MCSE 2003
MCSA 2003
MCITP Enterprise Administrator

If there are no stupid questions, then what kind of questions do stupid people ask? Do they get smart just in time to ask questions?
Scott Adams
 
It's taking extremely long time to backup these files.

Also my mft became corrupt recently and i suspect this is because of the amount of files.

When browsing that directory it also takes to very long time, several minutes to get the file listing.
 
I'm not surprised with 400,000 files in a single folder! Why so many files in a single folder?

I'm Certifiable, not cert-ified.
It just means my answers are from experience, not a book.

There are no more PDC's! There are DC's with FSMO roles!
 
Well it will take a long time to browse a directory with that many files in, use a command prompt.

What backup software have you used? And as davetoo asks why so many files in one folder??

Paul
MCSE 2003
MCSA 2003
MCITP Enterprise Administrator

If there are no stupid questions, then what kind of questions do stupid people ask? Do they get smart just in time to ask questions?
Scott Adams
 
Also what are you backing up to? Tape, DVD, hard drive....

Paul
MCSE 2003
MCSA 2003
MCITP Enterprise Administrator

If there are no stupid questions, then what kind of questions do stupid people ask? Do they get smart just in time to ask questions?
Scott Adams
 
Backing it up to tape, LTO2 Ultrium

Im using Veritas BackupExec 11d

Well the files are simply stored in one folder by a software. Would it be better if we placed 10000 files in one folder and then another 10000 files in another folder and so on?

 
Yes, if you have that option, I would break the files down into a logical structure...based upon date, or some criteria that makes sense as far as the data contained within the files is.

I'm Certifiable, not cert-ified.
It just means my answers are from experience, not a book.

There are no more PDC's! There are DC's with FSMO roles!
 
Status
Not open for further replies.

Part and Inventory Search

Sponsor

Back
Top