326 reputation
17
bio website blog.bitratchet.com
location United States
age 41
visits member for 4 years, 2 months
seen yesterday

Jed has maintained an all-weather bicycle commuting lifestyle, and is approaching his first ten thousand miles on his bike. Having started is IT career in 1994, he is now a Java programmer in Ferndale, WA.


Nov
18
comment what is the fastest and most reliable way of transferring a lot of files?
@bahamat thank you for making me look at the question again. My suggestion only seems appropriate if the transfer can occur over a VPN then. For an Internet transfer, I would certainly use ssh as well.
Nov
17
awarded  Commentator
Nov
17
comment what is the fastest and most reliable way of transferring a lot of files?
You can use faster encryption mechanisms if you need to. But you don't necessarily need to pipe this thru ssh. I prefer to set the -O and -I ports on mbuffer on both sides. Even tho this is now two commands, you skip the encryption and maximize network bandwidth by buffering both ends. I'm sending a tar stream at 720+Mbps on my local LAN with the equivalent of tar -cf - .|mbuffer -m128k -s 256M -I 9090 & mbuffer -m128k -s 256M -O host:9090 | tar -xf -
Nov
17
comment what is the fastest and most reliable way of transferring a lot of files?
well, given the affordability of gigabit LAN hardware, if its a LAN transfer, the time spent writing via eSATA to a single spindle is not all that attractive.
Nov
7
comment ZFS file deletion and its relationship to disk space
Be very careful when using the dedup option. Distributions like FreeNAS typically have FAQs on why ZFS is terribly slow when running dedup: it takes about 5MB of memory 1GB of space to dedup, so if you have 5TB of space, you might need 25GB ram to use it efficiently. See this writeup: constantin.glez.de/blog/2011/07/zfs-dedupe-or-not-dedupe
May
18
comment Linux e1000e (Intel networking driver) problems galore, where do I start?
Bummer - won't work for me: ethtool -e p11p5 | grep 0x0010 | awk '{print "0x"$13$12$15$14}' 0x105e8086
May
18
comment Linux e1000e (Intel networking driver) problems galore, where do I start?
ubuntu 13.04 with 3.9.2 - this does not work for me
May
14
awarded  Caucus
Aug
20
answered Apache: Redirect 404 and ErrorDocument 404 difference
Feb
7
awarded  Revival
Jan
31
awarded  Yearling
Jul
15
awarded  Nice Answer
Feb
2
answered Performance issues concurrently running MySQL and SQL Sever
Feb
2
answered MySQL not working under apache/php
Feb
2
answered MySQL 4.1 crashes with “Database was not shut down normally!”
Jan
31
answered serious problem with memory and crash on httpd and mysql
Jan
31
answered MySQL - Why would SHOW SLAVE HOSTS cause a binlog dump?
Jan
31
awarded  Supporter
Jan
31
comment mod_rewrite rules in httpd configuration
Rules modified in .htaccess files are read on every request. /etc/httpd/httpd.conf and /etc/httpd/conf.d/* are not. I trigger new changes to those files using service httpd reload which sends a SIGUSR1 to workers to restart gracefully.
Jan
31
comment mod_rewrite rules in httpd configuration
On Redhat systems the httpd.conf file is pretty generic and I wouldn't configure vhost settings in it. Define a vhost in /etc/httpd/conf.d instead.