The tag has no usage guidance.

learn more… | top users | synonyms

-1
votes
0answers
15 views

Optimizing Backup Server for Transfer Speed

We’ve built a backup server with both internal and external arrays for hosting our SQL and file server backups. The internal array is humming along but the external array is 10x slower to back up the ...
0
votes
2answers
46 views

What is the most efficient way to transfer files from AWS S3 to S3?

I have a large number of files stored in an AWS S3 bucket. I need to get those files to another S3 bucket owned by another user and in a different region. The files are stored in different locations ...
0
votes
1answer
2k views

Rsync hangs when transfering large files on an bad connection

've been having problems transferring files over a pretty bad connection (I'm trying to upload a file on a cloud server) via rsync. The rsync essentially hangs after about a minute or so. This is the ...
-1
votes
1answer
84 views

Is it possible to obtain the computer files of previous university researchers/employees if they used the university wifi? [closed]

Relevant Background I'm a post doc at a U.S. University. I need the files of a grad student research assistant who has left the lab. The student created files (data, codes, simulations, etc) for a ...
59
votes
4answers
114k views

robocopy transfer file and not folder

I'm trying to use robocopy to tranfer a single file from one location to another but robocopy seems to think I'm always specifying a folder. Here is an example: robocopy "c:\transfer_this.txt" "z:\...
0
votes
1answer
67 views

rsync/scp extremely slow transfer rate (<30kB/s) over fast connection

I am attempting to perform a backup using rsync of some files on a Digital Ocean VPS running Ubuntu 14.04.4 LTS. rsync is extremely slow, ranging from 20-50 kB/s, only 1% of what it should be. It is ...
43
votes
8answers
37k views

Quickest way to transfer 55GB of images to new server

I currently have two CentOS servers. I need to know how and what the quickest way would be to "tar" up the images directory and SCP it over? Is that the quickest way that I just suggested, because ...
1
vote
7answers
1k views

Secure file transfer in linux without SSH?

First thing i want to apologize if this question is silly or something...i just tried to research but it seems to be a bit hard to find exactly what i want in Google ! [or i'm not smart enough to find ...
1
vote
1answer
472 views

Transfer files with extended attributes: Redhat to Redhat

I need to transfer files with extended attributes from my local system (SL 6.5) to a remote server (Centos 5.6). However, both scp and rsync are dropping the attributes, so I'm having to manually ...
2
votes
4answers
6k views

Should I use rsync compression over a gigabit LAN?

I normally use rsync's -z option to enable compression when transferring files over the internet. However, if I am on my own (idle) gigabit LAN, do I still want compression? Or will it be faster ...
1
vote
0answers
26 views

Virtual disk backup: rsync alternative? [closed]

We currently use rsync to backup virtual disks to another computer. Rsync is slower than direct copy, but overwrite only modified parts in the destination files. This allow to make snapshots to have ...
1
vote
1answer
38 views

How to copy a host's entire disk to another, with checksum?

Both servers are running Linux. Is rsync a suitable choice? I know it's suitable for large file transfer, file synchronization etc. But not sure about a) entire disks b) checksums. Thanks in advance. ...
2
votes
1answer
67 views

Storage Space Write cache, and write speed

Hey guys i have been working on my NAS that is using server 2012r2 with storage spaces. the drives are off the shelf 7200 rpm drives the drives are bitlocker encrypted the drives are in a 8 disk ...
0
votes
0answers
17 views

What are the approaches to ensure bandwidth to a remote location?

Our file transfers have always been within our own network and it's been relatively easy to control QOS where we own the network equipment. But now, we are going to move one of our systems where we ...
-6
votes
1answer
114 views

Are HDD <-> SSD transfer speeds completely bottlenecked by HDD speed? [closed]

Is transferring data from an SSD to HDD and HDD to SSD speed about the same as HDD to HDD speed for both ways?
29
votes
8answers
21k views

Is there an equivalent to ssh-copy-id for Windows?

Is there any equivalent or port of ssh-copy-id available for Windows? That is, is there an easy way to transfer SSH keys from a local machine to a remote server under Windows? In case it helps, I'm ...
0
votes
0answers
22 views

ProFTPD returning 530 error despite the access credentials are correct

This week I configured ProFTPD in a Ubuntu Server. I created an user called test. This user was added to group proftpd. But despite this user password is correct, the server always returns an 530 ...
-1
votes
2answers
47 views

How to move PostgreSQL data directory?

My PostgreSQL installation by default uses /var/lib/pgsql directory to store data, backups and configuration files. As my disk space is running out, I have installed new hardware and mounted it in the ...
2
votes
0answers
96 views

Debug slow lan (ssh, nfs) file transfer

I've got two linux boxes attached to a gigabit switch. They both have gigabit NICs, cables are cat7. Testing the network with iperf shows a fast connection but transferring files with rsync, scp, or ...
4
votes
4answers
1k views

Openssh sftp-server: .filepart support?

I am trying to setup a SFTP server, running off Ubuntu Server 11.04. I installed openssh-server to provide SSH access. What I am trying to do is make file uploads run with a suffix (.filepart or ...
138
votes
13answers
151k views

Copying a large directory tree locally? cp or rsync?

I have to copy a large directory tree, about 1.8 TB. It's all local. Out of habit I'd use rsync, however I wonder if there's much point, and if I should rather use cp. I'm worried about permissions ...
1
vote
1answer
536 views

Automatically retrieve a specific file via SFTP

How do I determine which file is the newest from a remote server that I am connected to via SFTP? My goal is to retrieve a specific file each day, via SFTP. The steps I will follow are: Connect to ...
0
votes
0answers
34 views

ssh file tranfer freeze in file >100k

My ssh secure shell always freeze when I try to download file >100KB using SSH Secure File Transfer. Even if the download manage to start, the download speed is less than 1kb/s. But upload of large ...
2
votes
1answer
66 views

Get file system write cache queue size

I am copying a large amount of files from one server to another via robocopy to a UNC share. I notice that after robocopy completes that there is a large amount of disk activity that lasts for a ...
1
vote
1answer
53 views

Proftpd on Debian - trouble with file transfer

I have a rented VPS wieh debian installed. Recently I've installed proftpd in order to allow read-only access to everybody & full access for the particular users. I configured proftpd (with TLS) ...
0
votes
1answer
126 views

Server to Server file transfer through wget

I have a dedicated server in Germany with 120GB data, since I have bought a new dedicated server in U.S, I would like to transfer all the files to new server through FTP connection, to achieve this I'...
2
votes
3answers
1k views

Why does my local network transfer speed decrease with larger files?

Short version: I have a Linux server (RHEL5) and a Windows 7 Professional laptop on a local wired network. Copying large files to the server gets gradually slower until it stops completely. Long ...
1
vote
3answers
121 views

Python, RHEL and Push

I'm looking for advice on a solution to transfer various scripts to remote systems. Some kind of client/server application? Here is the situation. I have 32 Windows machines that are mobile and travel ...
69
votes
11answers
10k views

Transfer 15TB of tiny files

I'm archiving data from one server to another. Initially I started a rsync job. It took 2 weeks for it to build the file list just for 5 TB of data and another week to transfer 1 TB of data. Then I ...
9
votes
4answers
2k views

Linux to Linux, 10 TB transfer?

I've looked at all the previous similar questions, but the answers seemed to be all over the place and no one was moving a lot of data (100 GB is different from 10 TB). I've got about 10&...
63
votes
23answers
102k views

How to copy a large number of files quickly between two servers

I need to transfer a huge amount of mp3s between two serves (Ubuntu). By huge I mean about a million files which are on average 300K. I tried with scp but it would have taken about a week. (about 500 ...
5
votes
3answers
121 views

What is the difference between the download pause-able and un-pause-able files?

Technically, what is the difference between the way of hosting (on the server) of a file that can be paused while downloading and resumed again, and a file that needs to be downloaded in one go?
-1
votes
2answers
517 views

How can I quickly move files and folders from a local server to an amazon EC2 instance?

I'm moving script files from my local server to an amazon EC2 instance using winscp drag and drop, and it's taking too long. How can I move these files quickly?
1
vote
4answers
112 views

reliably write database dump directly to remote filesystem (Linux)

I need to move a very large database (~320 GB) from server1 to server2 (Linux). Because of different extension versions, the database can only be restored on server2 from a dump file as described here....
1
vote
1answer
1k views

synology ds212j slow transfer speed

I have Synology DS212j and I'm getting REALLY slow transfer speed, about ~10MB/s. I used following knowledge base in order to troubleshoot it: What should I do if file transfers are slow? - FAQ - ...
1
vote
0answers
96 views

Filezilla downloads failing for specific range of filesize?

I've been working with Filezilla at my work for a while now without any major issues, except this one. Conditions: Some issue causes file downloads to fail, since I have Filezilla set to ...
0
votes
0answers
40 views

Execute script on another server with file transfer

So I have a server running ubuntu 10.04 and I am using this program to merge PDFs called pdftk. It has a bug when I run it on 10.04, but not when I installed it on 14.04 (or presumably 12.04). ...
1
vote
2answers
107 views

Moving very large (~100 Gb) from one server to the other

We're moving servers, and I need to transfer all the data from Server A to Server B. I have a tar.gz of about 100Gb that contains all the Server A files. I'd really like to avoid downloading the ...
-2
votes
1answer
240 views

Windows Server 2008 R2 - Remote Desktop : how to allow user copy from client to server but prevent server to client? [closed]

I have windows server 2008R2. I & friends are using remote desktop for connecting to server. My problem is : I want to prevent user copy anything from server to client (or at least, file & ...
-1
votes
1answer
909 views

Why is scp with compression slower than without?

I needed to transfer a 20 GB KVM vdisk file, storing the root filesystem of a CentOS 6.5 VM, from one lab server to another. The large file size and the fact that I had once compressed such a vdisk ...
-2
votes
3answers
1k views

Fastest way to transfer files between servers [closed]

I am attempting to transfer a 8 GB tar file from one cpanel server to another. I have root access on the new server and jailed shell on the old. I attempted to wget and curl but I am getting speeds ...
5
votes
4answers
1k views

Transfer large amount of small files

I've to do a migration of two servers with large SAN attachments to our new VMWare environment. EDIT: I have to supply some additional intelligence as I have good answers regarding VMWare solution. ...
47
votes
16answers
14k views

Favorite rsync tips and tricks

The more I use rsync the more I realise that it's a swiss army knife of file transfer. There are so many options. I recently found out that you can go --remove-source-files and it'll delete a file ...
3
votes
5answers
838 views

What is the most efficient way to push out/publish large sets files over a network?

Here's my scenario: We have a need to push out a set of files (a 'workspace') from a source server to multiple destination servers. The files are kept under version control (SVN) so the first step is ...
15
votes
10answers
27k views

Easiest way for fast transfer of files between linux servers?

I need to transfer files from one CentOS server to another. Will transfer 5MB files about every 10 minutes. Do not need encryption. What is an easy was for fast transfer of files? Is there ...
1
vote
1answer
4k views

Easy way to transfer files between host and LXC container on LVM

This is an easy task in the case of containers that share the same filesystem but I'm not sure what would be the proper approach for containers that use LVM disks. I know I could use rsync or scp but ...
1
vote
2answers
2k views

RDP Copy&Paste Error: Windows cannot find '%1!ls!'

After working for years on mRemoteNG, and copying and pasting from servers I use all the time, I suddenly started getting the following error on a particular Windows 2003 server: Windows cannot find '...
1
vote
2answers
4k views

How to transfer huge files (50GB+) from remote Windows server?

I have a dedicated Windows Server in a remote data center, where my site is running along with a Microsoft SQL Server database. The database is is 50+ GB and I want to have a local backup of the ...
5
votes
2answers
253 views

Faster, secure, protocol/code required for long-distance transfer

I've ran into a problem and I'm looking for a new secure protocol/client/server that's faster over a 1Gb/s fibre link - let me tell you the story... I have a pair of redundant, diversely-routed, ...
-1
votes
1answer
55 views

Transfer file to server from FTP server [closed]

I've 2 server: Server A: Centos, webmin installed, with access to everything, SSH included. Server B: only FTP access On Server B I've a file of 10GB and I want to move it to Server A directly, and ...