The tag has no wiki summary.

learn more… | top users | synonyms

78
votes
15answers
84k views

Copying a large directory tree locally? cp or rsync?

I have to copy a large directory tree, about 1.8 TB. It's all local. Out of habit I'd use rsync, however I wonder if there's much point, and if I should rather use cp. I'm worried about permissions ...
0
votes
2answers
130 views

Alternative to FTP

I'm now teaching data bases and all my students get access to a virtual machine running ubuntu. They use FTP as the main way of connecting to the server and uploading their PHP files. Last time I was ...
7
votes
4answers
978 views

linux to linux, 10TB transfer?

I've looked at all the previous similar questions, but the answers seemed to be all over the place and no one was moving a lot of data (100GB != 10TB). I've got about 10TB that I need to move from ...
2
votes
2answers
181 views

CentOS 5.0 with Ligthttpd notices high traffic without reason

I have a CentOS 5 with Lightppd installed. Also I have MySQL on board. I lately discovered high traffic: http://img686.imageshack.us/img686/8596/traff.jpg Could you please tell me how to diagnose ...
15
votes
10answers
24k views

Easiest way for fast transfer of files between linux servers?

I need to transfer files from one CentOS server to another. Will transfer 5MB files about every 10 minutes. Do not need encryption. What is an easy was for fast transfer of files? Is there ...
7
votes
4answers
3k views

Rsync show progress for individual file

I'm using rsync to upload/download a pretty large file (20Gb). I'm aware of --progress option, but what it does in my case is just showing me the result at the end. My problem is that during some ...
0
votes
2answers
47 views

Prevent Rsync and SCP from causing page timeouts on LAMP server

I'm trying to run Rsync to move static files from our Dedicated server to our new cloud server. The following command works but when it runs it is stopping any web pages being served rsync -azP ...
-1
votes
1answer
299 views

Rsync hangs when transfering large files on an bad connection

've been having problems transferring files over a pretty bad connection (I'm trying to upload a file on a cloud server) via rsync. The rsync essentially hangs after about a minute or so. This is the ...
0
votes
1answer
148 views

RDP Copy&Paste Error: Windows cannot find '%1!ls!'

After working for years on mRemoteNG, and copying and pasting from servers I use all the time, I suddenly started getting the following error on a particular Windows 2003 server: Windows cannot find ...
0
votes
4answers
337 views

Win32 software to sync a file system to a FTP server using checksums?

The simple question is how do you sync a Windows file system to an FTP destination periodically while never checking the destination for change unless something bad happens and not relying on file ...
-2
votes
1answer
37 views

Does using ASCII transfer mode in FTP while transferring files from one linux based system to other linux based system changes LF to CRLF [duplicate]

Whether using ASCII transfer mode in FTP while transferring files from one linux based system to other linux based system changes LF to CRLF
13
votes
9answers
9k views

Windows rsync that supports long file names, or an good alternative?

I currently rsync on a Linux host to copy things from Windows to my Linux box. But I can't copy files with long names. I have tried DeltaCopy, cwrsync, and cygwin. From what I have found there all ...
0
votes
1answer
79 views

Leveraging rsync for a local copy between two slow drives, benefits without a daemon

I am confused by the benefits of rsync (3.1.1) if there is no daemon running remotely, e.g. copying from a drive mounted via SMB2 (via a VPN) to an external HDD (USB 2.0, sadly). Both connections are ...
0
votes
1answer
649 views

Apache configurations for Reverse Proxy

I am about to setup a reverse proxy server to filter and log page requests before relaying the actual content from the origin server. (new to this) Before this, I had the origin server public ...
2
votes
3answers
483 views

Should I use rsync compression over a gigabit LAN?

I normally use rsync's -z option to enable compression when transferring files over the internet. However, if I am on my own (idle) gigabit LAN, do I still want compression? Or will it be faster ...
0
votes
3answers
91 views

How to zip lots of folders into three+ independent zip files? [closed]

I have a massive amount of folders, and I want to zip/gzip/(what ever) them into 3 or more independent files. So for example, let's say I have this directories on my server: /dir1 /dir2 /dir3 /dir4 ...
1
vote
0answers
119 views

File transfering from Windows 2008 R2 to Windows 7 client is tremendously slow

I have main office and one branch. We have PTP 700mbit/s connection across them, and 1gb/s LAN at each office. The file server is at main office and its run on Windows 2008R2 Enterprise. Lately one ...
15
votes
6answers
9k views

Is there an equivalent to ssh-copy-id for Windows?

Is there any equivalent or port of ssh-copy-id available for Windows? That is, is there an easy way to transfer SSH keys from a local machine to a remote server under Windows? In case it helps, I'm ...
0
votes
1answer
66 views

Transfer files with extended attributes: Redhat to Redhat

I need to transfer files with extended attributes from my local system (SL 6.5) to a remote server (Centos 5.6). However, both scp and rsync are dropping the attributes, so I'm having to manually ...
13
votes
1answer
8k views

rsync - Exclude files that are over a certain size?

I am doing a backup of my desktop to a remote machine. I'm basically doing rsync -a ~ example.com:backup/ However there are loads of large files, e.g. wikipedia dumps etc. Most of the files I care a ...
-2
votes
1answer
589 views

How to move files between 2 servers, dedicated server and azure VM [closed]

I am moving from a dedicated server on a hosting company to a new windows azure VM, I need to transfer all files from dedicated server to the new VM, there are about 200GB files to move, I want to ...
0
votes
3answers
644 views

Getting irregular timestamps on NFS file server

Here is the situation: We have a file server that is not saving timestamps to a small portion of its files (77 files out of several million). It instead writes a default mtime of 1969-12-31 19:00 ...
-4
votes
1answer
70 views

How to transfer data between continents? [closed]

I want to transfer files from a server here in US to another one in China, and I wonder what's the best way to do it? Is there anything special needed to be considered compared to other file transfer ...
5
votes
1answer
3k views

Enable Remote Desktop File Transfer

Most of the servers I RDP to support cut-and-paste file transfer (from my Win7 64 machine). One does not, and I can't figure out what configuration step is missing. I followed the steps outlined ...
5
votes
5answers
440 views

Bash: mv directory one at a time

I am trying to move all subdirectories of a folder to another share on the same server. If I do a mv *, I will run out of space since the folders are not removed until all folders get transferred. ...
4
votes
1answer
4k views

ESXi 5.5, slow network speed when writing to guests

This is an issue that has been bugging me for a lot time with ESXi. I had the issue with my old Dell server (ESXi 5.0 and 5.5) and even with my new Dell T20 (ESXi 5.5). For the current issue at hand I ...
1
vote
1answer
106 views

Transfer 40000+ files usnig rsync between two servers

I have a problem with transfer files between two Linux servers in the same network. On source server I have directory with 40055 small files, directory size is 34 GB. I tried to transfer those files ...
0
votes
0answers
54 views

How to use zssh

I'm trying to download a file from root user, which is not directly accessible from ssh. I have installed zssh on my local machine and the server. This is where I'm at: zssh user@server login as ...
1
vote
4answers
1k views

File Transfer Alternatives

Right now we're using the enterprise product from Aspera. We've got a license that covers only 10megabits of throughput per connection. We're looking at migrating away from Aspera as their licensing ...
0
votes
1answer
152 views

Secure external file sharing / transfer - cloud or on-premise

My company is looking for a way to securely share sensitive information with some of our clients and trusted advisors. The idea is to be able to host files that are encrypted while at rest and in ...
0
votes
1answer
94 views

Could the IPG parameter in Robocopy cause TCP/IP packet problems if it is too high?

I need to throttle a robocopy transfer to limit bandwidth usage. It is already set to 1500 (/IPG:1500). I would like to increase this IPG to around 2000 (or more) in order to lower even more the ...
3
votes
1answer
188 views

How does a file get sent over an HTTP connection? [closed]

A teacher of mine says when you are browsing a web server such as apache2 that has file/directory listing enabled then it secretly opens an ftp server to transfer the file. This confuses me, though ...
0
votes
1answer
105 views

why copying take too long from my server to External drive [closed]

I don't understand why copying 244 GB of data from a Window server would be copying at the rate of 10.49KB/sec. The server RAM is 48 GB, Processor 2.19GHZ and hard drive of 1.75TB out which 491GB is ...
3
votes
5answers
653 views

What is the most efficient way to push out/publish large sets files over a network?

Here's my scenario: We have a need to push out a set of files (a 'workspace') from a source server to multiple destination servers. The files are kept under version control (SVN) so the first step is ...
-1
votes
2answers
120 views

How to transfer file(s) from a Unix system to a DOS system? [closed]

What is the simplest way to transfer files from a Unix system to a DOS system? Preferably without any "extra" tools on the DOS side.
1
vote
1answer
2k views

Connection drops while transferring large files to one server on a network

My company has two sites, each with their own LAN, using site to site VPN tunnel to connect the two sites. When transferring files (especially larger files) from site1 to site2 server1, the file ...
41
votes
15answers
10k views

Favorite rsync tips and tricks

The more I use rsync the more I realise that it's a swiss army knife of file transfer. There are so many options. I recently found out that you can go --remove-source-files and it'll delete a file ...
-2
votes
1answer
65 views

Transfer database from Red Hat Linux to WAMMP [closed]

I've currently got a MySQL 5.X database on a server running Red Hat Linux 4 (from memory), which I currently shell into with Putty. I now need to replicate the server in WAMP for offline debugging, ...
2
votes
1answer
132 views

Is it safe to rsync the same source to the same destination in parallel

My application use rsync to copy files from network driver to local as cache to improve performance. But since my application might be run in parallel, so as the rsync, and there could be a case that ...
0
votes
1answer
56 views

Copy directories modified by specific users within a certain time frame from an FTP [closed]

I am trying to cleanup a 12TB Windows FTP with several million files. Basically, I want to keep the directories that are still being used by a specific subset of users who had access, and only keep ...
1
vote
2answers
553 views

Why does my local network transfer speed decrease with larger files?

Short version: I have a Linux server (RHEL5) and a Windows 7 Professional laptop on a local wired network. Copying large files to the server gets gradually slower until it stops completely. Long ...
21
votes
5answers
31k views

What is the best way to transfer a single large file over a high-speed, high-latency WAN link?

This looks related to this one, but it's somewhat different. There is this WAN link between two company sites, and we need to transfer a single very large file (Oracle dump, ~160 GB). We've got full ...
1
vote
1answer
102 views

How to avoid deliberate corruption using a NAS for backup

This is an extension of my question here (Small office backups, small NAS (RAID) vs single disk). What would be a good way to structure a NAS backup solution to prevent deliberate corruption by a ...
4
votes
4answers
4k views

Multicast File Transfers

I'm looking for some multicast file transfer software. Do you have any suggestions? Must be "quickly implementable", i.e. no Tivoli or other stuff that requires a massive infrastructure. Must run on ...
1
vote
6answers
819 views

Transfer a 200 GB MDF file

Any ideas-quickest way, how to transfer a 200GB mdf file from one server to another?
1
vote
1answer
314 views

Multicast File copy with Unicast responses

I'm trying to do some multicast big file copies over to remote clients on the other side of a satellite link. The idea is to minimize the amount of traffic going up to the satellite. I tried using ...
0
votes
0answers
109 views

Odd FTP ASCII/BINARY transfer behavior after migrating to a new server

I recently got a dedicated server and after migration to the new machine I started noticing problems with file transfers. My FTP client, despite being set to auto, keeps uploading php files in binary ...
44
votes
23answers
67k views

How to copy a large number of files quickly between two servers

I need to transfer a huge amount of mp3s between two serves (Ubuntu). By huge I mean about a million files which are on average 300K. I tried with scp but it would have taken about a week. (about 500 ...
8
votes
6answers
15k views

How do you limit the bandwidth for a file copy?

I've got an old windows 2000 box in a remote location with a T1 connection and a vpn to my location. I normally use smb mounts to transfer files but now it's time to decommission the server and copy ...
1
vote
1answer
179 views

Automatically retrieve a specific file via SFTP

How do I determine which file is the newest from a remote server that I am connected to via SFTP? My goal is to retrieve a specific file each day, via SFTP. The steps I will follow are: Connect to ...