Too many FTP's!! ahhhh!

[clk430]

We have system of 9 maps (inbound) that GET FTP files from a remote server ever 5 minutes. These files then get built in a staging folder and then shot over to Commerce manager. The problem is, the vendor sending the files to us just increased their file count A LOT and our one little CPU gets hung up once a day. A simple restart get's the ball rolling.

Let alone staggering the trigger GET times, what else can I do to prevent a trainwreck of growing files and a hung server issues? Any setting in mercator.ini file that I can change?

We're on 6.7 Win2K.

 

[clk430]

Right now the SkipIfBusy = Yes. Maybe I should change it to NO to make it multitreaded?

Or set the workspace to FILE and Unique?

 

[eyetry]

If you're having problems based on your box's capability you may want to stay away from multi-theading.

Are you getting your files from one location on one remote server?

Are you feeding CMGR inbound or outbound data?

Are the files being concatinated in the staging area?

Are you queing the files up in staging until a specific time or event occurs? or, are they moved along as they arrive?

If you are ftping large files, are you allowing enough time between ftp's

 

[eyetry]

PS:

Do you have any idea which map or set of maps is causing the hangup?

If it's the FTP maps could you have a problem with bad connections? (look at the Management Console and check 'Adapter Connections')

 

[clk430]

We are getting files from one remote server and feeding the inbound data to CMGR. And yes, the files are being concatenated in the stagining folder. But the problem is apparent when the file just stops being built in the staging folder and just sit there and won't drop off.

But, I looked into the Management Console and checked the 'Adapter Connections' as suggested and
there were many FTP connections, but a handful of failures. Is there a trace file for them or can
a simple FTP 'time out' log an error there?

The maps do have staggered "begin after" start times - 4,6,7,9,10,11,12,13 and all my .ini settings are at default (actaully most are commented out).

 

[eyetry]

...Is there a trace file for them or can
a simple FTP 'time out' log an error there?..."

If you are using a map with an ftp command or rule ' -t ' should produce trace file 'm4ftp.mtr'. page:24 of 1056.pdf