Tagged Questions

The tag has no wiki summary.

learn more… | top users | synonyms

32
votes
23answers
43k views

How to copy a large number of files quickly between two servers

I need to transfer a huge amount of mp3s between two serves (Ubuntu). By huge I mean about a million files which are on average 300K. I tried with scp but it would have taken about a week. (about 500 ...
19
votes
8answers
6k views

Quickest way to transfer 55GB of images to new server

I currently have two CentOS servers. I need to know how and what the quickest way would be to "tar" up the images directory and SCP it over? Is that the quickest way that I just suggested, because ...
4
votes
3answers
7k views

Windows Server 2008 x64, Large File Transfers, and Memory Usage

I'm following up on this: http://serverfault.com/questions/37605/copying-large-file-to-remote-server-causes-it-to-run-out-of-physical-memory But figured I'd post this separately. I have a 64-bit ...
6
votes
6answers
9k views

How do you limit the bandwidth for a file copy?

I've got an old windows 2000 box in a remote location with a T1 connection and a vpn to my location. I normally use smb mounts to transfer files but now it's time to decommission the server and copy ...
4
votes
3answers
3k views

ESXi 4.1 slow file transfer

My problem is that when I transfer files to or from 2 of my ESXi 4.1 servers using Veeam's FastSCP utility, the transfer seems to be limited to about 5 MBs when I can transfer the same file from the ...
5
votes
6answers
1k views

what is the fastest and most reliable way of transferring a lot of files?

I'm trying to transfer about 100k files totaling 90gb. Right now I'm using rsync daemon but its slow 3.4mb/s and I need to do this a number of times. I'm wondering what options do I have that would ...
51
votes
15answers
40k views

Copying a large directory tree locally? cp or rsync?

I have to copy a large directory tree, about 1.8 TB. It's all local. Out of habit I'd use rsync, however I wonder if there's much point, and if I should rather use cp. I'm worried about permissions ...
12
votes
9answers
7k views

Windows rsync that supports long file names, or an good alternative?

I currently rsync on a Linux host to copy things from Windows to my Linux box. But I can't copy files with long names. I have tried DeltaCopy, cwrsync, and cygwin. From what I have found there all ...
11
votes
23answers
10k views

What is the simplest and fastest way to transfer large file through a Windows network?

I have a Window Server 2000 machine running MS SQL Server that stores over 20GB of data. The database is backed-up every day to the second harddrive. I want to transfer those backup files to another ...
8
votes
4answers
4k views

Transfer files via SSH

I want to use file transfer via SSH on some scripts. I've read it's possible to tar over ssh. Where should I start reading?
4
votes
4answers
2k views

Multicast File Transfers

I'm looking for some multicast file transfer software. Do you have any suggestions? Must be "quickly implementable", i.e. no Tivoli or other stuff that requires a massive infrastructure. Must run on ...
3
votes
5answers
454 views

What is the most efficient way to push out/publish large sets files over a network?

Here's my scenario: We have a need to push out a set of files (a 'workspace') from a source server to multiple destination servers. The files are kept under version control (SVN) so the first step is ...
3
votes
1answer
1k views

Windows 7 - Network File Copy Intermittently Fails During Upload to NAS

The client machine is running 64 bit Windows 7 and attempting to copy a relatively small file to our NAS device. The NAS device is a Lacie model running (I believe) some variant of Windows XP and has ...
1
vote
7answers
152 views

Secure file transfer in linux without SSH?

First thing i want to apologize if this question is silly or something...i just tried to research but it seems to be a bit hard to find exactly what i want in Google ! [or i'm not smart enough to find ...
1
vote
3answers
952 views

sftp chrooted dosent work with some sftp client (Cyberduck)

I'm not able working on SFTP+chrooted env Using internal-sftp directive it works, but i'm not able to set umask. (ex umask 002) Using sftp-server from openssh package dosent't work because login shell ...
0
votes
4answers
210 views

Managed Hosting vs Co-location

I am working on a project that will require for us to upload huge HD video files to a server. For simplicity, I was considering Managed Hosting at Rackspace with Cloud Files. However, the main work ...