Copying a large size of files through nfs mnt and network (rcp, etc)

[gatetec]

I need to copy ~ 3TB of files from a node to another. They are located in two different data centers. I am wondering nfs mnt and putting the files onto the mnt pt have any significant advantages over the network transfer (i.e. rcp, etc).

Thx much

 

[Breslau]

in it's basic form, nfs is a simple way to go about this, but it's one of your slower methods of file copying.

 

[gatetec]

why nfs is slower? I thought nfs is much faster than the others..

 

[Breslau]

well i can't give you the technical details because i can't remember them, been a while since i've dealt with this issue, but it has to do with the buffer sizes that nfs uses amoungst other things.

ftp is the way to go for just moving your stuff around as fast as possible.

 

[khalidaaa]

nfs or rcp! at the end it will go through the network! so why don't you test transfering a 1GB file and time the transaction! then you will have more accurate results in knowing how much each take for that 1GB and generalize your vision for the 3TB data!

Regards,
Khalid

 

[andy61]

As you have to go through the network and as that is nearly always the bottleneck, there could be some value in using compression on the transfer eg
gzip -c test.c|ssh systemx "gunzip -c>/tmp/test.c"

 

[dstxaix]

depending on how far the datacenters are, can these be copied to another media (tape, disk) and physically moved?