Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [file-transfer]

The tag has no usage guidance.

6
votes
3answers
297 views

Copying terabytes of hundreds of thousands of files in folder slow

I am currently running FreeNAS and using SMB 3 on windows machines to copy folders with 80000+ files that are all about 35MB each. Here is the config FreeNAS 2x40Gbps connections bonded connection ...
0
votes
1answer
54 views

File transfer to SMB (Ubuntu 18.04 => Synology 718+) very slow

I have Synology DS718+, which I am testing with one user (myself) currently. My transfer rates from my laptop to Synology of around 2 MB/s. However copying FROM Synology back to laptop is around 30 ...
1
vote
1answer
66 views

Permission denied when using scp, but able to ssh

I'm trying to copy a file from my local desktop to a remote server. Yes - the remote directory I want to copy to is set to chmod 777 Yes - the server is password protected, and I am sure I have the ...
0
votes
0answers
72 views

Why do file transfers to our FreeNAS server fail sometimes?

I work in a local community center as a layman IT-technician where we have to transfer hundreds of GB data every day (documents, audio files, videos and such). For this purpose, we have a small ...
4
votes
2answers
512 views

How do increase data transfer rate between my VMs

I saw lots of article,but didn't answer my question. My server use VMware vSphere Hypervisor. There are 20 virtual machines in my server. VM operating system : centos7 I already change my vSwitch ...
1
vote
1answer
45 views

Transfer speed to network share drops

I have an older HP Proliant ML350 G6 server with 1 x Xeon E5504 (2.0 ghz) and 8 gb ram. If I copy a large file (over 2 gb) to it from a windows 10 workstation, after about 1.5 gb the transfer speed ...
0
votes
1answer
332 views

SCP hangs before File Transfer begins

I am trying to move a file from a virtual machine (Ubuntu 18.04) on my local system to a remote server using a very basic scp command. This issue is present only on one particular server, others work ...
1
vote
2answers
99 views

Change the default SCP command flags in Linux

I am trying to move a file from a virtual machine (Ubuntu 18.04) on my local system to a remote server using a very basic scp command. This issue is present only on one particular server, others work ...
0
votes
1answer
317 views

How to verify checksum after copying 2 TB of 6 million files over USB?

I have a situation where I need to move over 2 TB of data from one server to another server in another data center. There are over 6 million files to copy. The plan is to move data in phases. For ...
5
votes
1answer
92 views

Server OS or PowerShell version differences that would affect copy speed?

I recently moved many, many files at 2 different locations. It was exactly the same set of data on each, using an identical robocopy command, but what took under 30 minutes on Windows Server 2012 R2 ...
0
votes
3answers
578 views

Move Large Azure Storage Container To Another Account

I have a large blob container in one Azure Storage Account in one Directory (abc.com) that I would like to move to another Storage Account in a completely different Directory (efg.com). Is the only ...
2
votes
1answer
1k views

Cannot transfer large file(s) using remote desktop connection (Windows 2012 server)

I am trying to transfer over a large file using remote desktop. I end up getting this error from the image below. Source computer is a windows 7 laptop and destination is a windows 2012R2 server. ...
-3
votes
1answer
41 views

Why is My Network file Transfer Slower Than (What I Thought) it Should Be? [closed]

I'm trying to copy a 40Gb 7zip archive within my network. The computer sending has an Intel Centrino 130, that's supposed to be 802.11 b/g/n compatible. The router is a Pace 4111n which is also ...
1
vote
1answer
91 views

Copy Windows files to SMB share (Synology) and keep all properties

I have a network drive with files that need to move to a new Synology NAS SMB network share. I'd like to transfer the files while keeping as much properties as possible. I tried robocopy and fastcopy,...
0
votes
2answers
39 views

How to track and log file transfers between Production and Non-Production environments?

We have a security/compliance audit that we are preparing for and since we deal with financial institutions, one of the potential flags mentioned was how we track/monitor files that are transferred ...
0
votes
1answer
21 views

How to allow “append only” (push) access from a remote server to a central server?

How to allow a remote server to push data onto a central server without having any other access. That is, how to allow the remote server to only append but not overwrite or read files on the central ...
1
vote
1answer
435 views

How to Diagnose Strange Network Failure

This is a strange one. I have 2 remote networks that I transfer files between over the internet. Yesterday, a regular backup job failed, so I started looking into it. I have been transferring files ...
1
vote
4answers
1k views

copy large number of files over ssh

I mount a remote server over ssh (using sshfs). I want to copy a large number of files from the remote server to local: cp -rnv /mounted_path/source/* /local_path/destination The command runs ...
2
votes
2answers
65 views

Transfer files between servers using laptop as intermediary

I'm in a situation where I have a significant amount of data that I need to transfer from Server A to Server C. However: Server A does not have network access to Server C I have authority to SSH to ...
0
votes
1answer
74 views

Transfer 300+ GB at maximum speed on two headless servers? [closed]

I am currently trying to transfer over 300GB from my Mac Pro server to my Synology NAS. I only have my Windows PC I can work from, but I can SSH into both devices. They are both connected to gigabit ...
1
vote
0answers
101 views

Data transfer with permissions (AD) from windows to linux

good day friends, I have a problem with the transfer of data (files and folders) from a windows server (integrated with active directory) to a linux server. The active directory delivers permissions, ...
3
votes
1answer
88 views

Transfer Speed Sudden Drop on Intel Raid Card between (2) 4 SSD Raid 0 Arrays

Preface; I have done hours of trouble shooting on this issue and simply cannot find out what the sudden "bottleneck" is. I have (2) 4 SSD Disk Raid 0 Arrays (3.8TB Each). They are run off a single ...
-3
votes
1answer
4k views

In a domain, how does one transfer files from one PC to another? [duplicate]

I googled it and all I got was how to transfer files from one domain to another domain. Say I have two PCs, one running windows server 2008 and the other running Windows 7, they're connected via a ...
0
votes
0answers
347 views

Batch file can't transfer file to FTP using ncftpput

I have this 4 servers that transfer file to FTP using batchfile periodically. The problem is, in 1 server, sometimes it works and sometimes not. When I try to run it manually in this server, sometimes ...
1
vote
1answer
793 views

Will the update flag in rsync transfer files if the timestamp is identical in source and destination? Documentation is unclear

I want to transfer changed and new files only, using rsync on Ubuntu 14.04. I don't want to transfer everything, every time. I'm not worried about checking if the content of the files have actually ...
0
votes
1answer
321 views

How to set up automatic atomic transfers over SFTP

I'm working on a personal project. Since I don't have to worry about working with others or deploying from a development environment to a production environment, I am simply modifying files on the ...
1
vote
1answer
506 views

SFTP is periodically extremely slow for no reason

I am transferring a bunch of gigabyte-sized files using SFTP over a fairly fast connection, between two servers running Ubuntu linux, with not much CPU load. I am usually able to reach 5.0 MB ...
0
votes
0answers
105 views

File transfer data corruption

I am having a very strange data/file corruption over GRE/IPSEC tunnels. I have two sites connected with WAN links (four links, 80mbps one, 50mbps another, and 20mbps remaining ones). I am using GRE ...
1
vote
0answers
142 views

How are cluster size, buffer size and packet size related for performance?

I'm creating a server on an embedded system. I have a FAT filesystem on an SD card which contains a file, which should be sent via HTTP to some client over wifi that connects to the system. At first ...
2
votes
2answers
57 views

HTTP to FTP with remote client

short version: a working equivalent to scp -3 http://user:pass@example.org/somefile ftp://user:pass@ftpserver/my/path detailed version: +------+ +-------+ +-------------+...
2
votes
3answers
3k views

TFTP requests Not being serviced

This may look like a duplicate question but I did my share of searching, but could not find any solution. I have created a tftp server, this server when accessed from a local tftp client, over a ...
0
votes
2answers
224 views

What is the most efficient way to transfer files from AWS S3 to S3?

I have a large number of files stored in an AWS S3 bucket. I need to get those files to another S3 bucket owned by another user and in a different region. The files are stored in different locations ...
0
votes
1answer
1k views

rsync/scp extremely slow transfer rate (<30kB/s) over fast connection

I am attempting to perform a backup using rsync of some files on a Digital Ocean VPS running Ubuntu 14.04.4 LTS. rsync is extremely slow, ranging from 20-50 kB/s, only 1% of what it should be. It is ...
2
votes
0answers
154 views

Virtual disk backup: rsync alternative? [closed]

We currently use rsync to backup virtual disks to another computer. Rsync is slower than direct copy, but overwrite only modified parts in the destination files. This allow to make snapshots to have ...
1
vote
1answer
150 views

How to copy a host's entire disk to another, with checksum?

Both servers are running Linux. Is rsync a suitable choice? I know it's suitable for large file transfer, file synchronization etc. But not sure about a) entire disks b) checksums. Thanks in advance. ...
2
votes
1answer
874 views

Storage Space Write cache, and write speed

Hey guys i have been working on my NAS that is using server 2012r2 with storage spaces. the drives are off the shelf 7200 rpm drives the drives are bitlocker encrypted the drives are in a 8 disk ...
0
votes
0answers
28 views

What are the approaches to ensure bandwidth to a remote location?

Our file transfers have always been within our own network and it's been relatively easy to control QOS where we own the network equipment. But now, we are going to move one of our systems where we ...
5
votes
1answer
476 views

Debug slow lan (ssh, nfs) file transfer

I've got two linux boxes attached to a gigabit switch. They both have gigabit NICs, cables are cat7. Testing the network with iperf shows a fast connection but transferring files with rsync, scp, or ...
-6
votes
1answer
994 views

Are HDD <-> SSD transfer speeds completely bottlenecked by HDD speed? [closed]

Is transferring data from an SSD to HDD and HDD to SSD speed about the same as HDD to HDD speed for both ways?
-1
votes
2answers
919 views

How to move PostgreSQL data directory?

My PostgreSQL installation by default uses /var/lib/pgsql directory to store data, backups and configuration files. As my disk space is running out, I have installed new hardware and mounted it in the ...
0
votes
0answers
56 views

ssh file tranfer freeze in file >100k

My ssh secure shell always freeze when I try to download file >100KB using SSH Secure File Transfer. Even if the download manage to start, the download speed is less than 1kb/s. But upload of large ...
2
votes
1answer
298 views

Get file system write cache queue size

I am copying a large amount of files from one server to another via robocopy to a UNC share. I notice that after robocopy completes that there is a large amount of disk activity that lasts for a ...
1
vote
1answer
153 views

Proftpd on Debian - trouble with file transfer

I have a rented VPS wieh debian installed. Recently I've installed proftpd in order to allow read-only access to everybody & full access for the particular users. I configured proftpd (with TLS) ...
0
votes
1answer
602 views

Server to Server file transfer through wget

I have a dedicated server in Germany with 120GB data, since I have bought a new dedicated server in U.S, I would like to transfer all the files to new server through FTP connection, to achieve this I'...
75
votes
11answers
13k views

Transfer 15TB of tiny files

I'm archiving data from one server to another. Initially I started a rsync job. It took 2 weeks for it to build the file list just for 5 TB of data and another week to transfer 1 TB of data. Then I ...
1
vote
4answers
401 views

reliably write database dump directly to remote filesystem (Linux)

I need to move a very large database (~320 GB) from server1 to server2 (Linux). Because of different extension versions, the database can only be restored on server2 from a dump file as described here....
1
vote
0answers
423 views

Filezilla downloads failing for specific range of filesize?

I've been working with Filezilla at my work for a while now without any major issues, except this one. Conditions: Some issue causes file downloads to fail, since I have Filezilla set to ...
0
votes
0answers
54 views

Execute script on another server with file transfer

So I have a server running ubuntu 10.04 and I am using this program to merge PDFs called pdftk. It has a bug when I run it on 10.04, but not when I installed it on 14.04 (or presumably 12.04). ...
1
vote
2answers
436 views

Moving very large (~100 Gb) from one server to the other

We're moving servers, and I need to transfer all the data from Server A to Server B. I have a tar.gz of about 100Gb that contains all the Server A files. I'd really like to avoid downloading the ...
-2
votes
1answer
280 views

Windows Server 2008 R2 - Remote Desktop : how to allow user copy from client to server but prevent server to client? [closed]

I have windows server 2008R2. I & friends are using remote desktop for connecting to server. My problem is : I want to prevent user copy anything from server to client (or at least, file & ...