Error writing huge amount of files to harddisk

[PjotrvA]

Hi,

I'm using a XP Pro (sp2) machine to record video in jpg format. I'm writing huge amounts of jpg files to a (spanned) volume. After I've written many files (varying from 150GB to 340GB), the machine stops recording. Indicating an invalid path to a file.

If I reboot, the computer just records the new jpg's. So I don't think I have a harddrive problem.
If I try to create a new directory on the drive, I get an error indicating I have insufficient system resources to complete the request.

Is this some kind of memory error?? Can't WinXP cope with a huge amount of files without rebooting?

Has someone got a suggestion to resolve this problem, or can someone nudge me in the right direction?

thnx Pjotr

 

[DragonQ0105]

How much RAM do you have and how fast is it?

Also, why are you saving Videos in JPG Format? You mean taking a screenshot of each Frame and saving it as a picture? Or did you mean MPEG/MPG?

How many acutal files does it complete before giving the error? Is it the same each time?

In WindowsXP the following Restrictions Apply:

- FAT32 (65,534 Files/Folders per Folder*)
- NTFS (4,294,967,295 Files/Folders per Folder)

*NOTE: If you use Long Filenames, this number reduces.

Now assuming you're using NTFS, have you got more than 4,294,967,295 Files in a single Folder??

 

[PjotrvA]

Hi,

Thnx for the reaction.
I must admit I was expecting the question about the 'screenshots'

I'm kind of using MJPEG compression, without the M.
We have a defined format regarding directories and filenames, so I can uniqly indentify every image. This is done to be able to display videoframes at a desired rate, wothout troubles from video (temporal) compression.

Most video codes can't display video at high display rates, without jitter and still be able to quickly jump to any desired frame.

The directory structure is based on time. And the largest directory has a maximum file amount of 1500 frames.
About the maximum amount of files of NTFS (4,294,967,295), I do not reach this NTFS limit.
I record PAL video with a maximum rate of 25 fps, with up to 4 channels(100 fps) At this speed, I use about 6000 files every minute. So I should be able to record more than 490 days, before I reach filecount limits.

I'll try to check if the filecount is the same, I do not know the answer to that question.

But if I reboot the computer, I can store more images. Therefore I think the problem lies in memory managment and not in NTFS limits......

Pjotr