The tag has no usage guidance.

learn more… | top users | synonyms

63
votes
23answers
102k views

How to copy a large number of files quickly between two servers

I need to transfer a huge amount of mp3s between two serves (Ubuntu). By huge I mean about a million files which are on average 300K. I tried with scp but it would have taken about a week. (about 500 ...
43
votes
8answers
37k views

Quickest way to transfer 55GB of images to new server

I currently have two CentOS servers. I need to know how and what the quickest way would be to "tar" up the images directory and SCP it over? Is that the quickest way that I just suggested, because ...
5
votes
4answers
1k views

Transfer large amount of small files

I've to do a migration of two servers with large SAN attachments to our new VMWare environment. EDIT: I have to supply some additional intelligence as I have good answers regarding VMWare solution. ...
5
votes
3answers
11k views

Windows Server 2008 x64, Large File Transfers, and Memory Usage

I'm following up on this: http://serverfault.com/questions/37605/copying-large-file-to-remote-server-causes-it-to-run-out-of-physical-memory But figured I'd post this separately. I have a 64-bit ...
21
votes
5answers
54k views

What is the best way to transfer a single large file over a high-speed, high-latency WAN link?

This looks related to this one, but it's somewhat different. There is this WAN link between two company sites, and we need to transfer a single very large file (Oracle dump, ~160 GB). We've got full ...
12
votes
6answers
24k views

How do you limit the bandwidth for a file copy?

I've got an old windows 2000 box in a remote location with a T1 connection and a vpn to my location. I normally use smb mounts to transfer files but now it's time to decommission the server and copy ...
10
votes
6answers
8k views

what is the fastest and most reliable way of transferring a lot of files?

I'm trying to transfer about 100k files totaling 90gb. Right now I'm using rsync daemon but its slow 3.4mb/s and I need to do this a number of times. I'm wondering what options do I have that would ...
5
votes
3answers
4k views

ESXi 4.1 slow file transfer

My problem is that when I transfer files to or from 2 of my ESXi 4.1 servers using Veeam's FastSCP utility, the transfer seems to be limited to about 5 MBs when I can transfer the same file from the ...
59
votes
4answers
114k views

robocopy transfer file and not folder

I'm trying to use robocopy to tranfer a single file from one location to another but robocopy seems to think I'm always specifying a folder. Here is an example: robocopy "c:\transfer_this.txt" "z:\...
13
votes
9answers
11k views

Windows rsync that supports long file names, or an good alternative?

I currently rsync on a Linux host to copy things from Windows to my Linux box. But I can't copy files with long names. I have tried DeltaCopy, cwrsync, and cygwin. From what I have found there all ...
13
votes
23answers
22k views

What is the simplest and fastest way to transfer large file through a Windows network?

I have a Window Server 2000 machine running MS SQL Server that stores over 20GB of data. The database is backed-up every day to the second harddrive. I want to transfer those backup files to another ...
4
votes
4answers
6k views

Multicast File Transfers

I'm looking for some multicast file transfer software. Do you have any suggestions? Must be "quickly implementable", i.e. no Tivoli or other stuff that requires a massive infrastructure. Must run on ...
9
votes
4answers
7k views

Transfer files via SSH

I want to use file transfer via SSH on some scripts. I've read it's possible to tar over ssh. Where should I start reading?
9
votes
4answers
2k views

Linux to Linux, 10 TB transfer?

I've looked at all the previous similar questions, but the answers seemed to be all over the place and no one was moving a lot of data (100 GB is different from 10 TB). I've got about 10&...
3
votes
5answers
838 views

What is the most efficient way to push out/publish large sets files over a network?

Here's my scenario: We have a need to push out a set of files (a 'workspace') from a source server to multiple destination servers. The files are kept under version control (SVN) so the first step is ...
4
votes
6answers
2k views

Looking for a faster way to transfer file to a windows network share

Update: This is just for one way transfer. No need to sync. I am currently using Robocopy to transfer a huge file which is zipped and send to a remote network share. Is there a faster tool? Lately, ...
3
votes
1answer
4k views

Windows 7 - Network File Copy Intermittently Fails During Upload to NAS

The client machine is running 64 bit Windows 7 and attempting to copy a relatively small file to our NAS device. The NAS device is a Lacie model running (I believe) some variant of Windows XP and has ...
1
vote
1answer
536 views

Automatically retrieve a specific file via SFTP

How do I determine which file is the newest from a remote server that I am connected to via SFTP? My goal is to retrieve a specific file each day, via SFTP. The steps I will follow are: Connect to ...
1
vote
3answers
1k views

sftp chrooted dosent work with some sftp client (Cyberduck)

I'm not able working on SFTP+chrooted env Using internal-sftp directive it works, but i'm not able to set umask. (ex umask 002) Using sftp-server from openssh package dosent't work because login shell ...
0
votes
4answers
223 views

Managed Hosting vs Co-location

I am working on a project that will require for us to upload huge HD video files to a server. For simplicity, I was considering Managed Hosting at Rackspace with Cloud Files. However, the main work ...