OK, Boca, Janhes and Eyetry have helped me identify why maps get a “source not available” on certain files, however the map actually pulls it.
The classic double trigger issue. An application drops the file, Mercator attempts to pick it up, but the file is not finished. A second map is kicked off when the file is finished and pulls the file, only for the first map not to have a file anymore. Thus, the double trigger.
Simple Fix: Have the application drop a trigger when the file is done or have them name it to a .tmp extension, then rename it when it’s complete.
Unfortunately, redesign is not an option at this point and either is having the application drop a trigger/rename. So what are my options to reduce the double trigger issue?
Example: Map #1 calls a batch file via the batch adapter to unzip a file. Map#2 (multithreaded) picks up the unzipped files (wild carded input source) and FTP’s them.
Map#2 Gets the source not available all the time because the winzip .exe is too slow releasing the files.
So how can I REDUCE the errors?
Single thread Map #2?
Map Delay (9999) on Map #2
.ini Trigger time increase?
The classic double trigger issue. An application drops the file, Mercator attempts to pick it up, but the file is not finished. A second map is kicked off when the file is finished and pulls the file, only for the first map not to have a file anymore. Thus, the double trigger.
Simple Fix: Have the application drop a trigger when the file is done or have them name it to a .tmp extension, then rename it when it’s complete.
Unfortunately, redesign is not an option at this point and either is having the application drop a trigger/rename. So what are my options to reduce the double trigger issue?
Example: Map #1 calls a batch file via the batch adapter to unzip a file. Map#2 (multithreaded) picks up the unzipped files (wild carded input source) and FTP’s them.
Map#2 Gets the source not available all the time because the winzip .exe is too slow releasing the files.
So how can I REDUCE the errors?
Single thread Map #2?
Map Delay (9999) on Map #2
.ini Trigger time increase?