The tag has no wiki summary.

learn more… | top users | synonyms

0
votes
1answer
1k views

file transfer with ssh pipe; without scp

Scenario: I'm having about hundred odd text files which are compressed as .gz. They need to be transferred to a remote server. I do not want to use scp. Both, linux servers. my requirement/my idea: I ...
1
vote
2answers
441 views

Multi threaded network file transfer

Many of the links that connect NY and AMS are often saturated. That means that running a transfer over them (e.g., move 300GB at 1MB/s) would take an age if compared with what our connections can ...
0
votes
2answers
212 views

Linux - regularily moving directory contents

Collaboration partners of our company will upload files (typically a few GB in size) to a directory on one of our external servers. From that directory, I will move them to our internal network, where ...
1
vote
1answer
379 views

Multicast File copy with Unicast responses

I'm trying to do some multicast big file copies over to remote clients on the other side of a satellite link. The idea is to minimize the amount of traffic going up to the satellite. I tried using ...
2
votes
1answer
515 views

Setting up a BITS server for upload only

Often we need to have clients send large backup sets to us. We currently use ftp, however we run in to the issue of the ftp client being closed on the client's computer before the the transfer is ...
1
vote
2answers
188 views

Transfer many files between job-processing servers

I have Server A that works on a portion of a job and generates a file as output. Server B works on the second part of the job but it needs the file that Serve A generated. What is the best way to get ...
0
votes
2answers
1k views

Moving a 13 gig file over sFTP (md5sum fails)

Each time I download a big file over sftp, the md5sum on the source machine doesn't match the md5sum I do on the destination machine. I have a 13gig file on an Ubuntu 12.04 machine with ...
3
votes
4answers
2k views

10Gbps iSCSI network transferring at only 2Gbps

I have a performance issue with my SAN. I have a full 10Gbps private network setup. I have the following setup 1 - Mac with Connected with via Fiber Transciever 10GbE 1 - Windows 7 PC with 10GbE 1 - ...
1
vote
2answers
3k views

How to transfer huge files (50GB+) from remote Windows server?

I have a dedicated Windows Server in a remote data center, where my site is running along with a Microsoft SQL Server database. The database is is 50+ GB and I want to have a local backup of the ...
1
vote
2answers
1k views

Scheduled File Transfer Between Servers

I am interested in scheduling the copying and sending of large files over the internet from one server to another. The servers are not on the same network. I do not know about all of my available ...
0
votes
3answers
2k views

Secure copying (file transfer) between two Linux servers in the same datacenter (Linode)

I have two Linodes in the same data center. I want to copy files from one to the other each night or on demand (for about the next month, until this project is finished). So I'm thinking about using ...
6
votes
4answers
1k views

Puppet file transfer slow

I have a puppet master and slaves in different datacenters. The latency between them is ~40ms. When I run "puppet agent --test" on a slave to apply the latest manifest it takes ~360 seconds to finish. ...
3
votes
2answers
2k views

Increase data transfer speed through bonding/lacp?

I want to maximize the throughput of a data transfer between two servers. The copy will be made at the application layer using Robocopy. To clear things up, please check my Visio schema of the ...
1
vote
5answers
523 views

Fast Internet Backup

We wish to install some servers in a remote datacentre to act as a backup storage location for our primary datacentre. Assuming that both sites will have GigE connectivity, what is the best method to ...
3
votes
3answers
8k views

Use scp to copy a file to different servers

I have to copy a file to different servers almost every day. What I usually do is: scp filename user@destinationhost:/destination/folder I run this same command changing the destination host over ...
1
vote
1answer
148 views

Terminal server - disconnect possible if no client activity, but file transfer

We are testing a file transfer script that is started through a client session on a terminal server - the client is Ubuntu rdesktop. What we find is that the session is disconnected after a while, ...
2
votes
3answers
448 views

Fast, reliable data transfers from/to China

We are a small company and we will need to transfer rather large amounts of data (10GB+ each time) between Europe and China in the near future. As many may have experienced, Internet connections to ...
0
votes
1answer
301 views

Copying compressed files from Server 2008 R2 network share to XP client via VPN fails

At the first sight the question looks similar to this one. I have experienced an odd behavior while trying to copy a certain file from Windows Server 2008 R2 network share to Windows XP Professional ...
4
votes
2answers
7k views

Speed up rsync by running multiple instances at once?

I have to transfer a big directory to another server. My problem is that i cannot use the full bandwidth that would be available, because one concurrent tcp stream does not get as fast. Basically ...
1
vote
4answers
117 views

What is a useful “transfer large things” method/medium? [closed]

Other than through the network, what does everyone use for transferring things like system images or very large files? For example, external case+hard drive like a myBook. Or, extremely large ...
2
votes
2answers
2k views

How to set up a torrent server on Ubuntu?

I need to distribute extremely large files over separated networks. (Netherlands to China, and Netherlands to India), files sizes vary from 5 to 50GB. Since file is stored on several machines, and ...
4
votes
6answers
979 views

How can we share large files with people outside of our firewall?

We sometimes need to share/recieve large files (sometimes in the gigabytes) to outside contractors or customers. These files are mostly CAD drawings, but could include almost anything. We want to only ...
-1
votes
1answer
134 views

How can I transfer a large number of big files over local network with pause/resume support? [closed]

My MacBook has about 400GB of files (videos, music, documents, etc.) that I need to transfer to a Windows PC over my local network. My router is semi-disfunctional, though, so every so often it stops ...
2
votes
1answer
431 views

Transfer Files From Multiple External USB Drives to Linux Server San Storage

We want to transfer files from multiple external USB drives to a Linux server connected to SAN storage. The USB Drives are formated with NTFS and contain media i.e. Images/Videos and will each range ...
3
votes
4answers
962 views

SSH file transfers hang after ~700KB

OVERVIEW I'm scripting SFTP file transfers on a Windows 7 box in the field. When I transfer zip files larger than a megabyte or so, the transfer (and SSH) stops unexpectedly after about 700KB. The ...
3
votes
2answers
517 views

Sharing large (multi-Gb) files with clients

I wasn't sure if this was the best place for this question, but I think it is squarely in the realm of the IT admin so that's the reason I put it here. We need to share large files (several ...
3
votes
1answer
159 views

Transferring data from old dedicated server to a new one

I have a Windows 2003 dedicated server account with WebFusion and they are just awful, I'm not afraid to say. I would like to transfer to a GoDaddy Windows 2008 dedicated server in the next week or ...
1
vote
2answers
2k views

When the TCP engine decides to send an ACK?

In my LAN, I have a router that runs a Samba server and my PC connects to the router. I wiresharked during a uploading to the server and a downloading from the server. The wireshar results show ...
2
votes
3answers
481 views

What is the fastest protocol for transferring small files between a high latency VPN?

I have ~70ms latency over my VPN connection and need to set up a backup/replication system. SMB is the worst, with throughput ~200KB/s. SCP gives me ~400KB/s. HTTP ~700KB/s. The links are symmetric ...
0
votes
1answer
130 views

Transfer files between Shared Hosting servers using FTPES

I have two shared hosting servers and a VPS. One at ixwebhostings with their panel and other is a cPanel hosting. I would like to move some files between these two. ixwebhosting supports FTP and ...
3
votes
2answers
304 views

Why data sending is heavier for CPU than data receiving?

I have a Samba server configured in my PC. When other PCs in LAN download data from the server, top command shows smbd occupies 75% CPU. While they transfer data to the server, top command shows smbd ...
3
votes
1answer
3k views

How can I boost WiFi data transfer rate?

I have a wireless router that clients are using to have internet and file transfer in our company. The link speed is 54Mbit within all clients. But it seems that is impossible to exceed ~8 mbit which ...
0
votes
2answers
345 views

Web server slow when transfering many images

Here is a little background of a intermittent but very real problem. I maintain a web application that is running on Esxi private cloud. We have a database server, and 4 web application servers. The 4 ...
3
votes
1answer
131 views

Network issue - Very slow while RXing but TXing is fine

I am trying to transfer a 10GB file to test my network. But when I transfer from Workstation 1 to Workstation 2, it takes 8 minutes (which is fine). But from Workstation 2 to Workstation 1, the ...
2
votes
2answers
127 views

File transfer - Bandwidth flickering for no reason

We are experiencing file transfer issues. I try to troubleshoot this problem but it is really hard. Here is a screenshot I took while transferring a file from my workstation to another server. The ...
0
votes
1answer
229 views

Transferring 60GB of data over fiber connection - VPN connection times out [closed]

In an attempt to transfer a 60GB file (SQL database file) over the wire via a VPN connection, we're only able to get about 1/8 the file over. How can we get around this timeout issue? Or do we have ...
0
votes
3answers
278 views

What's the best way to transfer a huge folder (4GB+) across Servers

I need to transfer a dvd's worth of content in a folder - many small files, some big across servers on a consistent basis. What's the best way of doing this? This is for a windows server ...
9
votes
6answers
7k views

what is the fastest and most reliable way of transferring a lot of files?

I'm trying to transfer about 100k files totaling 90gb. Right now I'm using rsync daemon but its slow 3.4mb/s and I need to do this a number of times. I'm wondering what options do I have that would ...
1
vote
4answers
3k views

How can I automate the process of fetching files from remote Windows servers?

We have a handful of machines that we administer: some Windows 2003/8 and some various flavors of Unix. I need to write some sort of script/task/etc (I'm a programmer, so any language/tool is fine) ...
3
votes
1answer
1k views

Checksumming to verify rsync transfers

So rsync runs some checksums in the course of deciding what to transfer (i.e. what blocks within a file). But is there any reason to trust the file you end up with on the receive side any more than ...
3
votes
1answer
3k views

Windows 7 - Network File Copy Intermittently Fails During Upload to NAS

The client machine is running 64 bit Windows 7 and attempting to copy a relatively small file to our NAS device. The NAS device is a Lacie model running (I believe) some variant of Windows XP and has ...
2
votes
2answers
242 views

how to optimize transatlantic TCP transfers?

I transfer large files between two of my servers one in the US and the other in the Netherlands and I'm wondering if there are any tweaks I can apply that will increase the speed of a transatlantic ...
2
votes
3answers
2k views

How to avoid stalled scp transfer when tunneling through a gateway over ssh?

I'm try to transfer a large (1GB+) file from one machine to another, but I have to tunnel through a gateway in between. I'm able to transfer small files just fine. However, with the big file, the ...
79
votes
12answers
9k views

Transfer 10TB of files from USA -> UK datacenter

I am migrating my server from the USA to the UK from one data center to another, my host said I should be able to achieve 11 megabytes per second. Operating system is Windows Server 2008 at both ...
-2
votes
2answers
312 views

Need to transfer ~3TB of data to a remote server [duplicate]

Possible Duplicate: Copy large file from one Linux server to another I need to transfer about ~3tb of data to another server. I am currently using rsync -z but it is going at 250kb/s so it ...
0
votes
2answers
3k views

How can I ensure non-corrupt file transfer in linux?

I have script scheduled with cron that transfers a file around to other machines using scp filename user@host:~ and today have noticed that sometimes the md5 of the files don't match. Upon closer ...
2
votes
3answers
2k views

Fastest way to copy large file directory over slow internet

I need to copy a directory from one of our servers several hundred miles away. Both sites where I am and where the files are have business cable. The cable is 5 Mbps(Down) / 768 Kbps(Up). This poses a ...
3
votes
6answers
2k views

Transfer a file from remote server A to remote server B from server C

I have an interesting problem I'm trying to solve. I have a JumpBox server that I have in order to securely ssh into client's servers. This is the only server my clients ever open up port 22 to. ...
-2
votes
3answers
1k views

How to transfer files betwen 2 hosting servers?

I have a live website that I want to change my hosting provider to a new hosting company. Currently I have several gigabytes of data as a .zip files in my old hosting environment that I want to shift ...
2
votes
2answers
820 views

Transfer large files over the internet from a Linux VPS to Windows machine

I regularly need to transfer files that are a few gigabytes in size from a Linux VPS to my home Windows machine. I am trying to find a transfer method that fits my needs. FTP/SFTP works but is quite ...