The tag has no wiki summary.

learn more… | top users | synonyms

0
votes
3answers
1k views

Secure copying (file transfer) between two Linux servers in the same datacenter (Linode)

I have two Linodes in the same data center. I want to copy files from one to the other each night or on demand (for about the next month, until this project is finished). So I'm thinking about using ...
6
votes
4answers
1k views

Puppet file transfer slow

I have a puppet master and slaves in different datacenters. The latency between them is ~40ms. When I run "puppet agent --test" on a slave to apply the latest manifest it takes ~360 seconds to finish. ...
3
votes
2answers
2k views

Increase data transfer speed through bonding/lacp?

I want to maximize the throughput of a data transfer between two servers. The copy will be made at the application layer using Robocopy. To clear things up, please check my Visio schema of the ...
1
vote
5answers
484 views

Fast Internet Backup

We wish to install some servers in a remote datacentre to act as a backup storage location for our primary datacentre. Assuming that both sites will have GigE connectivity, what is the best method to ...
3
votes
3answers
5k views

Use scp to copy a file to different servers

I have to copy a file to different servers almost every day. What I usually do is: scp filename user@destinationhost:/destination/folder I run this same command changing the destination host over ...
1
vote
1answer
142 views

Terminal server - disconnect possible if no client activity, but file transfer

We are testing a file transfer script that is started through a client session on a terminal server - the client is Ubuntu rdesktop. What we find is that the session is disconnected after a while, ...
2
votes
3answers
381 views

Fast, reliable data transfers from/to China

We are a small company and we will need to transfer rather large amounts of data (10GB+ each time) between Europe and China in the near future. As many may have experienced, Internet connections to ...
0
votes
1answer
247 views

Copying compressed files from Server 2008 R2 network share to XP client via VPN fails

At the first sight the question looks similar to this one. I have experienced an odd behavior while trying to copy a certain file from Windows Server 2008 R2 network share to Windows XP Professional ...
4
votes
2answers
6k views

Speed up rsync by running multiple instances at once?

I have to transfer a big directory to another server. My problem is that i cannot use the full bandwidth that would be available, because one concurrent tcp stream does not get as fast. Basically ...
1
vote
4answers
115 views

What is a useful “transfer large things” method/medium? [closed]

Other than through the network, what does everyone use for transferring things like system images or very large files? For example, external case+hard drive like a myBook. Or, extremely large ...
2
votes
2answers
2k views

How to set up a torrent server on Ubuntu?

I need to distribute extremely large files over separated networks. (Netherlands to China, and Netherlands to India), files sizes vary from 5 to 50GB. Since file is stored on several machines, and ...
4
votes
6answers
725 views

How can we share large files with people outside of our firewall?

We sometimes need to share/recieve large files (sometimes in the gigabytes) to outside contractors or customers. These files are mostly CAD drawings, but could include almost anything. We want to only ...
-1
votes
1answer
117 views

How can I transfer a large number of big files over local network with pause/resume support? [closed]

My MacBook has about 400GB of files (videos, music, documents, etc.) that I need to transfer to a Windows PC over my local network. My router is semi-disfunctional, though, so every so often it stops ...
2
votes
1answer
330 views

Transfer Files From Multiple External USB Drives to Linux Server San Storage

We want to transfer files from multiple external USB drives to a Linux server connected to SAN storage. The USB Drives are formated with NTFS and contain media i.e. Images/Videos and will each range ...
3
votes
4answers
478 views

SSH file transfers hang after ~700KB

OVERVIEW I'm scripting SFTP file transfers on a Windows 7 box in the field. When I transfer zip files larger than a megabyte or so, the transfer (and SSH) stops unexpectedly after about 700KB. The ...
3
votes
2answers
462 views

Sharing large (multi-Gb) files with clients

I wasn't sure if this was the best place for this question, but I think it is squarely in the realm of the IT admin so that's the reason I put it here. We need to share large files (several ...
3
votes
1answer
141 views

Transferring data from old dedicated server to a new one

I have a Windows 2003 dedicated server account with WebFusion and they are just awful, I'm not afraid to say. I would like to transfer to a GoDaddy Windows 2008 dedicated server in the next week or ...
1
vote
2answers
2k views

When the TCP engine decides to send an ACK?

In my LAN, I have a router that runs a Samba server and my PC connects to the router. I wiresharked during a uploading to the server and a downloading from the server. The wireshar results show ...
2
votes
3answers
387 views

What is the fastest protocol for transferring small files between a high latency VPN?

I have ~70ms latency over my VPN connection and need to set up a backup/replication system. SMB is the worst, with throughput ~200KB/s. SCP gives me ~400KB/s. HTTP ~700KB/s. The links are symmetric ...
4
votes
6answers
714 views

Effect of distance from server on page load speed

I measured the load speed of a static image file severed by nginx from my server (using pingdom service). The server should normally process this request within few seconds. My server is located in ...
0
votes
1answer
122 views

Transfer files between Shared Hosting servers using FTPES

I have two shared hosting servers and a VPS. One at ixwebhostings with their panel and other is a cPanel hosting. I would like to move some files between these two. ixwebhosting supports FTP and ...
3
votes
2answers
296 views

Why data sending is heavier for CPU than data receiving?

I have a Samba server configured in my PC. When other PCs in LAN download data from the server, top command shows smbd occupies 75% CPU. While they transfer data to the server, top command shows smbd ...
3
votes
1answer
3k views

How can I boost WiFi data transfer rate?

I have a wireless router that clients are using to have internet and file transfer in our company. The link speed is 54Mbit within all clients. But it seems that is impossible to exceed ~8 mbit which ...
0
votes
2answers
314 views

Web server slow when transfering many images

Here is a little background of a intermittent but very real problem. I maintain a web application that is running on Esxi private cloud. We have a database server, and 4 web application servers. The 4 ...
3
votes
1answer
125 views

Network issue - Very slow while RXing but TXing is fine

I am trying to transfer a 10GB file to test my network. But when I transfer from Workstation 1 to Workstation 2, it takes 8 minutes (which is fine). But from Workstation 2 to Workstation 1, the ...
2
votes
2answers
117 views

File transfer - Bandwidth flickering for no reason

We are experiencing file transfer issues. I try to troubleshoot this problem but it is really hard. Here is a screenshot I took while transferring a file from my workstation to another server. The ...
0
votes
1answer
205 views

Transferring 60GB of data over fiber connection - VPN connection times out [closed]

In an attempt to transfer a 60GB file (SQL database file) over the wire via a VPN connection, we're only able to get about 1/8 the file over. How can we get around this timeout issue? Or do we have ...
0
votes
3answers
243 views

What's the best way to transfer a huge folder (4GB+) across Servers

I need to transfer a dvd's worth of content in a folder - many small files, some big across servers on a consistent basis. What's the best way of doing this? This is for a windows server ...
7
votes
6answers
5k views

what is the fastest and most reliable way of transferring a lot of files?

I'm trying to transfer about 100k files totaling 90gb. Right now I'm using rsync daemon but its slow 3.4mb/s and I need to do this a number of times. I'm wondering what options do I have that would ...
1
vote
4answers
2k views

How can I automate the process of fetching files from remote Windows servers?

We have a handful of machines that we administer: some Windows 2003/8 and some various flavors of Unix. I need to write some sort of script/task/etc (I'm a programmer, so any language/tool is fine) ...
3
votes
1answer
986 views

Checksumming to verify rsync transfers

So rsync runs some checksums in the course of deciding what to transfer (i.e. what blocks within a file). But is there any reason to trust the file you end up with on the receive side any more than ...
3
votes
1answer
2k views

Windows 7 - Network File Copy Intermittently Fails During Upload to NAS

The client machine is running 64 bit Windows 7 and attempting to copy a relatively small file to our NAS device. The NAS device is a Lacie model running (I believe) some variant of Windows XP and has ...
2
votes
2answers
232 views

how to optimize transatlantic TCP transfers?

I transfer large files between two of my servers one in the US and the other in the Netherlands and I'm wondering if there are any tweaks I can apply that will increase the speed of a transatlantic ...
2
votes
3answers
2k views

How to avoid stalled scp transfer when tunneling through a gateway over ssh?

I'm try to transfer a large (1GB+) file from one machine to another, but I have to tunnel through a gateway in between. I'm able to transfer small files just fine. However, with the big file, the ...
76
votes
12answers
8k views

Transfer 10TB of files from USA -> UK datacenter

I am migrating my server from the USA to the UK from one data center to another, my host said I should be able to achieve 11 megabytes per second. Operating system is Windows Server 2008 at both ...
-2
votes
2answers
281 views

Need to transfer ~3TB of data to a remote server [duplicate]

Possible Duplicate: Copy large file from one Linux server to another I need to transfer about ~3tb of data to another server. I am currently using rsync -z but it is going at 250kb/s so it ...
0
votes
2answers
3k views

How can I ensure non-corrupt file transfer in linux?

I have script scheduled with cron that transfers a file around to other machines using scp filename user@host:~ and today have noticed that sometimes the md5 of the files don't match. Upon closer ...
2
votes
3answers
2k views

Fastest way to copy large file directory over slow internet

I need to copy a directory from one of our servers several hundred miles away. Both sites where I am and where the files are have business cable. The cable is 5 Mbps(Down) / 768 Kbps(Up). This poses a ...
3
votes
6answers
1k views

Transfer a file from remote server A to remote server B from server C

I have an interesting problem I'm trying to solve. I have a JumpBox server that I have in order to securely ssh into client's servers. This is the only server my clients ever open up port 22 to. ...
-2
votes
3answers
836 views

How to transfer files betwen 2 hosting servers?

I have a live website that I want to change my hosting provider to a new hosting company. Currently I have several gigabytes of data as a .zip files in my old hosting environment that I want to shift ...
2
votes
2answers
702 views

Transfer large files over the internet from a Linux VPS to Windows machine

I regularly need to transfer files that are a few gigabytes in size from a Linux VPS to my home Windows machine. I am trying to find a transfer method that fits my needs. FTP/SFTP works but is quite ...
1
vote
4answers
1k views

File Transfer Alternatives

Right now we're using the enterprise product from Aspera. We've got a license that covers only 10megabits of throughput per connection. We're looking at migrating away from Aspera as their licensing ...
0
votes
4answers
195 views

Secure file transfer to transfer files to clients

Today, our company is using an FTP Server to transfer files to clients, vendors and more. Now, we want something more secure. Needs Uploading with FTP (Windows Explorer, no own program), Browser ...
1
vote
5answers
272 views

Transfer files using ssh

I am using ssh (WinSCP) to transfer some files from a server to my workstation. The problem is that at some files I get disconnected. Always same files. I am the owner of the directory so I guess ...
3
votes
2answers
609 views

Openssh sftp-server: .filepart support?

I am trying to setup a SFTP server, running off Ubuntu Server 11.04. I installed openssh-server to provide SSH access. What I am trying to do is make file uploads run with a suffix (.filepart or ...
2
votes
4answers
254 views

possible efficient ways of transferring files from one server to another

what are the possible good and efficient ways of transferring files from one server to another? In this case it will be from windows server 2003 to windows server 2008 r2. I am thinking Powershell ...
1
vote
4answers
738 views

wget an remote website index directory

Is it possible to wget an entire index/parent directory with wget? Because I am trying to transfer images to a VPS of mine from my old shared host. When I say an index/parent directory, I meant like ...
1
vote
1answer
389 views

Ubuntu + Copy Folder Remotely Either By Using SCP or Any Other Command

By using SCP Command, File is transfered from one system to remote system. But I want to transfer whole folder from local system to remote system. So How it can be possible. Please help me out ?
2
votes
1answer
542 views

rsync to import/export delta-transfer or incremental copy result

My scenario is to distribute several GB files from a staging server to tens of identical destination servers. Since rsync can do delta-transfer or incremental copy, I was wondering when rsync file to ...
1
vote
1answer
307 views

cwRsync performance on Win Server 2003

I've tested several cases for cwRsync (3.0) on Win Server 2003. My scenario is have a rsync daemon on a source host with source files ~3GB total. And there're 50 dest servers running rsync command to ...