The tag has no wiki summary.

learn more… | top users | synonyms

4
votes
1answer
260 views

Out of Disk Space, /mnt/hgfs to blame?

I'm running a Centos VM in VMWare Fusion 5.x. The VM is running a file transfer server and the files being sent are stored on a disk shared from the host, /mnt/hgfs/Aspera. It looks like the file ...
1
vote
2answers
191 views

Multi threaded network file transfer

Many of the links that connect NY and AMS are often saturated. That means that running a transfer over them (e.g., move 300GB at 1MB/s) would take an age if compared with what our connections can ...
0
votes
1answer
427 views

file transfer with ssh pipe; without scp

Scenario: I'm having about hundred odd text files which are compressed as .gz. They need to be transferred to a remote server. I do not want to use scp. Both, linux servers. my requirement/my idea: I ...
2
votes
3answers
321 views

Fast, reliable data transfers from/to China

We are a small company and we will need to transfer rather large amounts of data (10GB+ each time) between Europe and China in the near future. As many may have experienced, Internet connections to ...
7
votes
6answers
4k views

what is the fastest and most reliable way of transferring a lot of files?

I'm trying to transfer about 100k files totaling 90gb. Right now I'm using rsync daemon but its slow 3.4mb/s and I need to do this a number of times. I'm wondering what options do I have that would ...
0
votes
2answers
155 views

Linux - regularily moving directory contents

Collaboration partners of our company will upload files (typically a few GB in size) to a directory on one of our external servers. From that directory, I will move them to our internal network, where ...
3
votes
4answers
1k views

10Gbps iSCSI network transferring at only 2Gbps

I have a performance issue with my SAN. I have a full 10Gbps private network setup. I have the following setup 1 - Mac with Connected with via Fiber Transciever 10GbE 1 - Windows 7 PC with 10GbE 1 - ...
2
votes
1answer
265 views

Setting up a BITS server for upload only

Often we need to have clients send large backup sets to us. We currently use ftp, however we run in to the issue of the ftp client being closed on the client's computer before the the transfer is ...
5
votes
4answers
13k views

ASCII vs Binary vs Auto?

I'm transferring files between servers and just started noticing that some of them are getting modified to be one long continuous line as opposed to having the returns and line-breaks they originally ...
1
vote
2answers
168 views

Transfer many files between job-processing servers

I have Server A that works on a portion of a job and generates a file as output. Server B works on the second part of the job but it needs the file that Serve A generated. What is the best way to get ...
0
votes
2answers
694 views

Moving a 13 gig file over sFTP (md5sum fails)

Each time I download a big file over sftp, the md5sum on the source machine doesn't match the md5sum I do on the destination machine. I have a 13gig file on an Ubuntu 12.04 machine with ...
0
votes
3answers
2k views

server 2008r1 slow file transfer in one direction

I have a problem of slow file transfer in one direction on a 3 of my servers with 2008 on them. the test i have done is to copy a 400Mb file from a PC to 1 server takes approx 30 secs if i then try to ...
0
votes
0answers
225 views

FTP transfer speeds - each file seems to be limited

I'm not sure if this is an issue, or configuration problem, or just the way it is but I am doing a large transfer of files between data centres, Washington DC -> Salt Lake City, around 14TB total, ...
1
vote
2answers
679 views

Scheduled File Transfer Between Servers

I am interested in scheduling the copying and sending of large files over the internet from one server to another. The servers are not on the same network. I do not know about all of my available ...
3
votes
6answers
356 views

Simple Distributed Disconnected way to sync a directory

I want to start regularly backup my home directory on my ubuntu laptop, machine X. Suppose I have access to 2 different remote (linux) servers that I can backup to, machines A & B. Machine X will ...
0
votes
3answers
1k views

Secure copying (file transfer) between two Linux servers in the same datacenter (Linode)

I have two Linodes in the same data center. I want to copy files from one to the other each night or on demand (for about the next month, until this project is finished). So I'm thinking about using ...
1
vote
7answers
6k views

Compressing and copying large files on Windows Server?

I've been having a hard time copying large database backups from the database server to a test box at another site. I'm open to any ideas that would help me get this database moved without having to ...
3
votes
2answers
1k views

Increase data transfer speed through bonding/lacp?

I want to maximize the throughput of a data transfer between two servers. The copy will be made at the application layer using Robocopy. To clear things up, please check my Visio schema of the ...
1
vote
5answers
422 views

Fast Internet Backup

We wish to install some servers in a remote datacentre to act as a backup storage location for our primary datacentre. Assuming that both sites will have GigE connectivity, what is the best method to ...
0
votes
0answers
58 views

Kermit - how-to select files based on age

I've been asked to code a method to move FTP files from 'many' directories to 'one'. Files to be moved must be older than 15 minutes OR have completed their upload. On my first pass at the problem ...
3
votes
3answers
2k views

Use scp to copy a file to different servers

I have to copy a file to different servers almost every day. What I usually do is: scp filename user@destinationhost:/destination/folder I run this same command changing the destination host over ...
1
vote
4answers
1k views

How can I automate the process of fetching files from remote Windows servers?

We have a handful of machines that we administer: some Windows 2003/8 and some various flavors of Unix. I need to write some sort of script/task/etc (I'm a programmer, so any language/tool is fine) ...
0
votes
7answers
5k views

How to move files from one server to another?

I have about 600MB on a remote web server that I'd like to copy to a PC, then copy to a new server. I tried FileZilla, but it failed partway through the transfer from the old server and couldn't ...
1
vote
1answer
129 views

Terminal server - disconnect possible if no client activity, but file transfer

We are testing a file transfer script that is started through a client session on a terminal server - the client is Ubuntu rdesktop. What we find is that the session is disconnected after a while, ...
0
votes
1answer
166 views

Copying compressed files from Server 2008 R2 network share to XP client via VPN fails

At the first sight the question looks similar to this one. I have experienced an odd behavior while trying to copy a certain file from Windows Server 2008 R2 network share to Windows XP Professional ...
4
votes
2answers
5k views

Speed up rsync by running multiple instances at once?

I have to transfer a big directory to another server. My problem is that i cannot use the full bandwidth that would be available, because one concurrent tcp stream does not get as fast. Basically ...
1
vote
4answers
115 views

What is a useful “transfer large things” method/medium? [closed]

Other than through the network, what does everyone use for transferring things like system images or very large files? For example, external case+hard drive like a myBook. Or, extremely large ...
1
vote
2answers
1k views

How to set up a torrent server on Ubuntu?

I need to distribute extremely large files over separated networks. (Netherlands to China, and Netherlands to India), files sizes vary from 5 to 50GB. Since file is stored on several machines, and ...
3
votes
2answers
388 views

Sharing large (multi-Gb) files with clients

I wasn't sure if this was the best place for this question, but I think it is squarely in the realm of the IT admin so that's the reason I put it here. We need to share large files (several ...
6
votes
3answers
603 views

Hosted form of web-based file transfer tools [closed]

I'm looking for some software that will provide a service that resembles SendThisFile.com. My users generally turn to services like these when they are trying to send files that exceed the mail ...
4
votes
6answers
555 views

How can we share large files with people outside of our firewall?

We sometimes need to share/recieve large files (sometimes in the gigabytes) to outside contractors or customers. These files are mostly CAD drawings, but could include almost anything. We want to only ...
-2
votes
3answers
453 views

How to transfer files betwen 2 hosting servers?

I have a live website that I want to change my hosting provider to a new hosting company. Currently I have several gigabytes of data as a .zip files in my old hosting environment that I want to shift ...
0
votes
3answers
197 views

What's the best way to transfer a huge folder (4GB+) across Servers

I need to transfer a dvd's worth of content in a folder - many small files, some big across servers on a consistent basis. What's the best way of doing this? This is for a windows server ...
3
votes
1answer
113 views

Transferring data from old dedicated server to a new one

I have a Windows 2003 dedicated server account with WebFusion and they are just awful, I'm not afraid to say. I would like to transfer to a GoDaddy Windows 2008 dedicated server in the next week or ...
-1
votes
1answer
101 views

How can I transfer a large number of big files over local network with pause/resume support? [closed]

My MacBook has about 400GB of files (videos, music, documents, etc.) that I need to transfer to a Windows PC over my local network. My router is semi-disfunctional, though, so every so often it stops ...
3
votes
4answers
248 views

SSH file transfers hang after ~700KB

OVERVIEW I'm scripting SFTP file transfers on a Windows 7 box in the field. When I transfer zip files larger than a megabyte or so, the transfer (and SSH) stops unexpectedly after about 700KB. The ...
2
votes
1answer
189 views

Transfer Files From Multiple External USB Drives to Linux Server San Storage

We want to transfer files from multiple external USB drives to a Linux server connected to SAN storage. The USB Drives are formated with NTFS and contain media i.e. Images/Videos and will each range ...
3
votes
5answers
5k views

server 2008 to 2003 slow filetransfer using cifs

I just tried copying a file over cifs (windows file sharing) between a server 2003 R2 and a new server 2008 SP1 and I'm getting horrible speed. it's a 300MB file that is taking around 30 minutes to ...
1
vote
2answers
1k views

When the TCP engine decides to send an ACK?

In my LAN, I have a router that runs a Samba server and my PC connects to the router. I wiresharked during a uploading to the server and a downloading from the server. The wireshar results show ...
4
votes
6answers
559 views

Effect of distance from server on page load speed

I measured the load speed of a static image file severed by nginx from my server (using pingdom service). The server should normally process this request within few seconds. My server is located in ...
1
vote
5answers
250 views

Transfer files using ssh

I am using ssh (WinSCP) to transfer some files from a server to my workstation. The problem is that at some files I get disconnected. Always same files. I am the owner of the directory so I guess ...
2
votes
3answers
319 views

What is the fastest protocol for transferring small files between a high latency VPN?

I have ~70ms latency over my VPN connection and need to set up a backup/replication system. SMB is the worst, with throughput ~200KB/s. SCP gives me ~400KB/s. HTTP ~700KB/s. The links are symmetric ...
0
votes
1answer
111 views

Transfer files between Shared Hosting servers using FTPES

I have two shared hosting servers and a VPS. One at ixwebhostings with their panel and other is a cPanel hosting. I would like to move some files between these two. ixwebhosting supports FTP and ...
3
votes
1answer
575 views

Checksumming to verify rsync transfers

So rsync runs some checksums in the course of deciding what to transfer (i.e. what blocks within a file). But is there any reason to trust the file you end up with on the receive side any more than ...
3
votes
2answers
277 views

Why data sending is heavier for CPU than data receiving?

I have a Samba server configured in my PC. When other PCs in LAN download data from the server, top command shows smbd occupies 75% CPU. While they transfer data to the server, top command shows smbd ...
3
votes
1answer
2k views

How can I boost WiFi data transfer rate?

I have a wireless router that clients are using to have internet and file transfer in our company. The link speed is 54Mbit within all clients. But it seems that is impossible to exceed ~8 mbit which ...
0
votes
2answers
266 views

Web server slow when transfering many images

Here is a little background of a intermittent but very real problem. I maintain a web application that is running on Esxi private cloud. We have a database server, and 4 web application servers. The 4 ...
3
votes
1answer
116 views

Network issue - Very slow while RXing but TXing is fine

I am trying to transfer a 10GB file to test my network. But when I transfer from Workstation 1 to Workstation 2, it takes 8 minutes (which is fine). But from Workstation 2 to Workstation 1, the ...
2
votes
2answers
111 views

File transfer - Bandwidth flickering for no reason

We are experiencing file transfer issues. I try to troubleshoot this problem but it is really hard. Here is a screenshot I took while transferring a file from my workstation to another server. The ...
0
votes
1answer
167 views

Transferring 60GB of data over fiber connection - VPN connection times out [closed]

In an attempt to transfer a 60GB file (SQL database file) over the wire via a VPN connection, we're only able to get about 1/8 the file over. How can we get around this timeout issue? Or do we have ...