0
votes
2answers
35 views

Prevent Rsync and SCP from causing page timeouts on LAMP server

I'm trying to run Rsync to move static files from our Dedicated server to our new cloud server. The following command works but when it runs it is stopping any web pages being served rsync -azP ...
1
vote
1answer
95 views

Transfer 40000+ files usnig rsync between two servers

I have a problem with transfer files between two Linux servers in the same network. On source server I have directory with 40055 small files, directory size is 34 GB. I tried to transfer those files ...
-1
votes
2answers
116 views

How to transfer file(s) from a Unix system to a DOS system? [closed]

What is the simplest way to transfer files from a Unix system to a DOS system? Preferably without any "extra" tools on the DOS side.
2
votes
1answer
122 views

Is it safe to rsync the same source to the same destination in parallel

My application use rsync to copy files from network driver to local as cache to improve performance. But since my application might be run in parallel, so as the rsync, and there could be a case that ...
1
vote
6answers
550 views

Secure file transfer in linux without SSH?

First thing i want to apologize if this question is silly or something...i just tried to research but it seems to be a bit hard to find exactly what i want in Google ! [or i'm not smart enough to find ...
0
votes
1answer
97 views

Rsync a directory from a local server to a remote server without losing permissions

I need to transfer a directory from my local server to a remote server on the exact same place on the remote server. In the directory, there are a lot of different users involved and I want to ...
0
votes
8answers
3k views

How to speed up file transfer from server to server over the Internet? [duplicate]

How can I transfer a file from one server to another server with a great speed ? right now I am using FTP to transfer a file but it is taking so much time. To transfer a file of 2 GB its taking around ...
7
votes
4answers
3k views

Rsync show progress for individual file

I'm using rsync to upload/download a pretty large file (20Gb). I'm aware of --progress option, but what it does in my case is just showing me the result at the end. My problem is that during some ...
4
votes
1answer
301 views

Out of Disk Space, /mnt/hgfs to blame?

I'm running a Centos VM in VMWare Fusion 5.x. The VM is running a file transfer server and the files being sent are stored on a disk shared from the host, /mnt/hgfs/Aspera. It looks like the file ...
0
votes
2answers
182 views

Linux - regularily moving directory contents

Collaboration partners of our company will upload files (typically a few GB in size) to a directory on one of our external servers. From that directory, I will move them to our internal network, where ...
1
vote
2answers
178 views

Transfer many files between job-processing servers

I have Server A that works on a portion of a job and generates a file as output. Server B works on the second part of the job but it needs the file that Serve A generated. What is the best way to get ...
0
votes
3answers
1k views

Secure copying (file transfer) between two Linux servers in the same datacenter (Linode)

I have two Linodes in the same data center. I want to copy files from one to the other each night or on demand (for about the next month, until this project is finished). So I'm thinking about using ...
3
votes
3answers
4k views

Use scp to copy a file to different servers

I have to copy a file to different servers almost every day. What I usually do is: scp filename user@destinationhost:/destination/folder I run this same command changing the destination host over ...
2
votes
1answer
309 views

Transfer Files From Multiple External USB Drives to Linux Server San Storage

We want to transfer files from multiple external USB drives to a Linux server connected to SAN storage. The USB Drives are formated with NTFS and contain media i.e. Images/Videos and will each range ...
1
vote
2answers
2k views

When the TCP engine decides to send an ACK?

In my LAN, I have a router that runs a Samba server and my PC connects to the router. I wiresharked during a uploading to the server and a downloading from the server. The wireshar results show ...
3
votes
2answers
291 views

Why data sending is heavier for CPU than data receiving?

I have a Samba server configured in my PC. When other PCs in LAN download data from the server, top command shows smbd occupies 75% CPU. While they transfer data to the server, top command shows smbd ...
0
votes
2answers
3k views

How can I ensure non-corrupt file transfer in linux?

I have script scheduled with cron that transfers a file around to other machines using scp filename user@host:~ and today have noticed that sometimes the md5 of the files don't match. Upon closer ...
2
votes
2answers
655 views

Transfer large files over the internet from a Linux VPS to Windows machine

I regularly need to transfer files that are a few gigabytes in size from a Linux VPS to my home Windows machine. I am trying to find a transfer method that fits my needs. FTP/SFTP works but is quite ...
2
votes
3answers
331 views

Moving a lot of small files

I have to transfer a directory with lots of small files (250k, avg size 5mb) from one server to another. Both run on Debian Linux. Is there a protocol that is recommendable regarding the transfer of ...
0
votes
1answer
95 views

Centralized System for Managing Data Ingest/Output

The company I work for produces software that takes in Gigabytes of data a day, and outputs (lesser amounts of) Gigs a day. We have a significant infrastructure for managing data flow, and by ...
0
votes
4answers
8k views

Quickest way to transfer a file from remote Linux to Windows?

I need to transfer a file (~15 Mb) from a remote Linux machine to my local Windows box over the Internet and I was just wondering what would be the best way to do it? The Linux machine is a server ...
1
vote
3answers
182 views

most simple way to get files on a server

I am on windows and my server is linux. I would like to grab files from the server automatically with a script. Maybe execute a bash script remotely as well but maybe i dont need that. I need to ...
7
votes
4answers
977 views

linux to linux, 10TB transfer?

I've looked at all the previous similar questions, but the answers seemed to be all over the place and no one was moving a lot of data (100GB != 10TB). I've got about 10TB that I need to move from ...
1
vote
1answer
303 views

Rsync and Lazy mode?

Since transferring or copying a file that is being used sometimes causes corruption of the transferred file, can we define a time interval in which Rsync checks each file in a given directory to see ...
14
votes
3answers
18k views

Getting rsync to move file from source to destination?

Is rsync is a good choice for my project ? I have to : - copy files from source to destination folder via SSH, - be sure all files are copied, - delete source files after copy. - if I have conflict ...
0
votes
2answers
1k views

Get files from serial port SSH shell

My webserver networking is down. I can open a shell over SSH using serial port. I need to download 2 files (an sql dump and a backup of the entire website: aprox 3GB). To open the shell I must to ...
3
votes
6answers
364 views

Simple Distributed Disconnected way to sync a directory

I want to start regularly backup my home directory on my ubuntu laptop, machine X. Suppose I have access to 2 different remote (linux) servers that I can backup to, machines A & B. Machine X will ...
13
votes
1answer
8k views

rsync - Exclude files that are over a certain size?

I am doing a backup of my desktop to a remote machine. I'm basically doing rsync -a ~ example.com:backup/ However there are loads of large files, e.g. wikipedia dumps etc. Most of the files I care a ...
6
votes
6answers
1k views

Remote file copy util (like rsync) but that will take account of data already copied (in this session)?

Let's say I have a directory with 2 files, both are identical and quite large (e.g. 2GB ea.) I want to rsync that directory to a remote host. As I understand it (and I could be wrong), rsync ...
2
votes
2answers
181 views

CentOS 5.0 with Ligthttpd notices high traffic without reason

I have a CentOS 5 with Lightppd installed. Also I have MySQL on board. I lately discovered high traffic: http://img686.imageshack.us/img686/8596/traff.jpg Could you please tell me how to diagnose ...
1
vote
3answers
1k views

Corrupted zip file after using split and cat on Linux

I had to split this 2.6 GB zip-file in order to send it thru a slow uplink. I did this: split -b 879m BIGFILE.zip This created xaa, xab & xac which I uploaded to the remote server. After the ...
0
votes
1answer
870 views

FTP put several directories without overwrite?

I was transferring a few dozen gigs from one PC to another with scp. I got disconnected and double checked and found FTP to be faster (I scp only affected CPU to encrypt) How do I resume my file ...
1
vote
3answers
257 views

Linux transfer files from old server to new server

I've been googling this topic, but there no good suggestions on how to transfer files from old Linux new server. My goals are: Transfer all files, including hidden files Preserve permissions ...
3
votes
6answers
420 views

Replacement for FTP?

I have some fairly large file transfers going across the atlantic every morning by ftp. From time to time the transfers will be distrupted, likely due connectivity issues, and the files will be left ...
2
votes
4answers
334 views

Downloading files from internet to RHEL5 server

How to download a file from a location in internet to RHEL5 server running at runlevel 3 (without GUI)? Like, can we use sftp to directly download files from a website? Or, do we have any commands ...
0
votes
5answers
3k views

copy a folder under linux server to windows server

Hello I need to find a way to transfer the daily backup folder of my Debian server to a Windows server weekly. What would be the easiest and most stable way to achieve this? Would I definitely need a ...
0
votes
2answers
190 views

Stream backup from Linux to Windows

I have a Linux server with almost no disk space left. I fact i there is not enough space left to write a full backup to the disk, so i wonder if there is a good way to stream the backup directly to my ...
41
votes
15answers
9k views

Favorite rsync tips and tricks

The more I use rsync the more I realise that it's a swiss army knife of file transfer. There are so many options. I recently found out that you can go --remove-source-files and it'll delete a file ...
9
votes
1answer
3k views

Getting rsync to delete files from the *sender* after transfer

I'm using rsync to move one directory to another. Is there some way to get rsync to incrementally delete a file from the sender after it has copied it to the reciever?
78
votes
15answers
81k views

Copying a large directory tree locally? cp or rsync?

I have to copy a large directory tree, about 1.8 TB. It's all local. Out of habit I'd use rsync, however I wonder if there's much point, and if I should rather use cp. I'm worried about permissions ...
15
votes
10answers
23k views

Easiest way for fast transfer of files between linux servers?

I need to transfer files from one CentOS server to another. Will transfer 5MB files about every 10 minutes. Do not need encryption. What is an easy was for fast transfer of files? Is there ...
43
votes
23answers
65k views

How to copy a large number of files quickly between two servers

I need to transfer a huge amount of mp3s between two serves (Ubuntu). By huge I mean about a million files which are on average 300K. I tried with scp but it would have taken about a week. (about 500 ...