Incomplete FTP Files 1

[tbohon]

I have a situation where my ftp script is grabbing a large file before it's completely generated on the source system. Normally I'd have the source system write a flag file which, if present, indicates that the file I really want has been completed. However, management wants the process expanded to some 35+ databases/servers ... and getting everything modified to write flag files (and to maintain that logic through updates, etc.) would be a nightmare.

Does anyone have any suggestions? Someone told me to turn on the 'incomplete file' flag ... but can't find any reference to that nor have I ever heard of it before.

Thanks in advance for your assistance.

Best,

Tom

"My mind is like a steel whatchamacallit ...

 

[LKBrwnDBA]

Rename file after transfer:

OPEN ...
PUT MyFile.txt MyFile.tmp
RENAME MyFile.tmp MyFile.txt
BYE

----------------------------------------------------------------------------
The person who says it can't be done should not interrupt the person doing it. -- Chinese proverb

 

[tbohon]

Thanks for the input. Guess I don't fully understand how this will solve the problem of grabbing a file before it's been fully generated ... ???

Tom

"My mind is like a steel whatchamacallit ...

 

[LKBrwnDBA]

Well, the trick is that the process at the target server will be looking for a file with a specific name, therefore it will not find it until the transfer is complete and the file renamed to the correct name.

----------------------------------------------------------------------------
The person who says it can't be done should not interrupt the person doing it. -- Chinese proverb

 

[tbohon]

Hmmmmmm ... interesting. And this will work when I'm going out to do a get on the file as well?

Tom

"My mind is like a steel whatchamacallit ...

 

[vgersh99]

tbohon,
why doncha try and see it.

vlad
+----------------------------+
| #include<disclaimer.h> |
+----------------------------+

 

[LKBrwnDBA]

And this will work when I'm going out to do a get on the file as well?

Only if the source does the same thing, naming the file with expected name when process is complete.



----------------------------------------------------------------------------
The person who says it can't be done should not interrupt the person doing it. -- Chinese proverb

 

[LKBrwnDBA]

On doing a get if you are SURE the source file is 'complete' you can 'GET' the file to temporary name and then after the ftp, rename it:

$ FTP <<EOF
OPEN ...
GET MyFile.txt MyFile.tmp
BYE
EOF
$ mv MyFile.tmp MyFile.txt

----------------------------------------------------------------------------
The person who says it can't be done should not interrupt the person doing it. -- Chinese proverb