817 reputation
615
bio website ole.tange.dk
location
age
visits member for 3 years, 10 months
seen 18 hours ago

2d
comment filesystem for millions of small files
This weekend I had a dir on ext4 with 1000000 files in it. As long as you do not do ls or tab-completion it works fast. Probably due to the index.
Mar
6
awarded  Notable Question
Feb
19
awarded  Popular Question
Feb
15
revised How to parallelize the for loop while scp the files?
added 109 characters in body
Feb
15
answered How to parallelize the for loop while scp the files?
Dec
28
revised Gnu parallel & pipe
deleted 204 characters in body
Dec
28
comment How to parallelize the scp command?
I have had a situation where it was neither the disk bandwidth nor the network bandwidth that limited the performance. It was network latency. In that situation I got a factor of 3 performance boost by using GNU Parallel (see other answer).
Dec
28
comment How to parallelize the scp command?
How to use GNU Parallel: gist.github.com/rcoup/5358786 and gnu.org/software/parallel/man.html#example__parallelizing_rsync
Dec
27
comment Gnu parallel & pipe
It is not clear whether your program only only reads a single line or more lines. If we assume your program is 'wc', then this works: 'cat input.txt | parallel --pipe wc' or if you want a single line: 'cat input.txt | parallel -N1 --pipe wc'
Dec
27
comment Gnu parallel & pipe
Disable --tollef (often it is in /etc/parallel/config) then walk through the tutorial gnu.org/software/parallel/parallel_tutorial.html
Dec
27
comment Gnu parallel & pipe
Did you have a chance to go through the tutorial: gnu.org/software/parallel/parallel_tutorial.html
Dec
26
comment Gnu parallel & pipe
What does 'parallel --version' give? Are you sure it is GNU Parallel?
Dec
24
answered Gnu parallel & pipe
Dec
14
awarded  Popular Question
Nov
11
comment Global Redirection of port 80 to 443
I would like to stress that I agree with @plasmid87: Run a real web server and not some shell magic: Chances are that an untested shell script will not cover all corner cases.
Nov
11
answered Global Redirection of port 80 to 443
Aug
5
comment mpt2sas1: log_info(0x31120303): Disks dropped from RAID
Of 462 devices the invalid_dword_count: 135 are > 0, 99 are > 10, 44 are > 100, 20 are > 1000, 7 are > 10000, 3 are > 1000000. From that I think I am going to look into the 3 disks that have > 90% of the count.
Aug
5
comment mpt2sas1: log_info(0x31120303): Disks dropped from RAID
Firmware on the systems are P15/P16.
Jul
15
awarded  Nice Question
Jul
15
comment Harddisks falling offline for unknown reason
@ewwhite 24-45 disk per server.