up vote 0 down vote favorite
share [g+] share [fb]

I am using Doors for synchronization of my project modules. However if i have to synchronize modules for two different servers located at two different locations, say from Pune to Hallstadt. What script can I use for faster transfer of zipped files whilst synchronizing?

link|improve this question
2  
Care to give us something useful to work with, such as what OS you're using? – John Gardeniers Mar 28 '11 at 6:24
The servers are on unix, while i am working on a windows XP. I want to synchronize the project modules between 2 different servers located at Germany and India using IBM Doors. However, while synchronizing, Doors takes a hell lot of time to transfer zipped files. I need a solution to reduce this transfer time significantly. – rishi Mar 28 '11 at 6:43
feedback

2 Answers

up vote 1 down vote

You might try to use rsync - it would sync one directory to another, transferring only changed parts of files. There are also number of windows versions, like cwrsync.

EDIT: oh, you want to synchronize two unix servers. Most modern unixes already have rsync or have rsync package available. To synchronize server1 to server2 you need to execute something like that on server1:

rsync -razv --progress /path/to/soruce/dir/ username@server2:/path/to/destination/dir/

This syntax tells rsync to use ssh, so you don't need to run rsync server and transfer would be encrypted.

link|improve this answer
Yes, that is my second choice. It helps for the failed transfers as well. Would let you guys know, if anything helps. Thanks all – rishi Mar 28 '11 at 7:31
1  
You'll likely want to use -a for archive mode (transfers recursively, preserves permissions, etc.) and -z to compress before transferring. See the rsync(1) man page for more details. – justarobert Mar 28 '11 at 8:47
Yep, thanks, I've edited my answer. – rvs Mar 28 '11 at 9:49
feedback
up vote 0 down vote

If you are not already passing the data through a VPN, you can try this as it can provide some increase in transfer. Else you have the options of purchasing larger pipes to the locations or making the files smaller. You could try QOS, but it won't effect much unless the bottle neck is on your network which is unlikely.

link|improve this answer
You are right about the bottlenect. I suspect DOORS' fault in time consuming, that is why, I am looking for a script that could actually speed up the transfer. – rishi Mar 28 '11 at 6:58
Also, I have tried: Mounting a file system on other server, and transferring files using netcat. But this does not seem to be a good idea, does it? – rishi Mar 28 '11 at 7:00
I believe VPN won't help at all. It could only help if it would include compression, but original post described transferring zipped files, so compression won't help. VPN is a security tool, not a bandwidth accelerator. – rvs Mar 28 '11 at 7:27
In theory VPN would help, the same notion applies to using VNC to remote machines. VPNs can help to improve data transfer rates as they utilize data checking and transfer in a different manor than a normal transfer over the internet. For this case I believe it will boil down to the protocol you use to handle the data transfer. Netcat would be worth a try as I believe it does use a different transfer protocol than rsync. As for a script to speed up transfer speeds, the best you could do is maybe a script that shuts down other open connections. – Mike Soule Mar 28 '11 at 7:34
Thank you all, would let you know the best result. :-) – rishi Mar 28 '11 at 7:49
feedback

Your Answer

 
or
required, but never shown
discard

Not the answer you're looking for? Browse other questions tagged or ask your own question.