up vote 0 down vote favorite
share [g+] share [fb]

I'm going to build a cluster lab to test solutions and new applications for use in a larger cluster considered to be highly available, scalable and fault tolerant. I want to know available open source solutions for such a cluster lab, any proposal or comment is appreciated.

link|improve this question
feedback

1 Answer

up vote 2 down vote

There are quite a few different solutions you could go with, depending on what you ultimately are trying to accomplish ( and I would even try to pick one that mimics the big one)

Most common might be Beowulf Clusters. Other Parrellel ones are PVM or MPICH2. Or you can even custom write some software that offloads task to a set of known machines. (I know Gentoo does this with distcc to distribute the task of compiling software).

I think it really depends on what you are trying to do / mimic.

For data intensive, check out Apache's Hadoop it's an open-source project of utilities, file system and mapreduce implementation

link|improve this answer
My applications will be data-intensive and optimised to have high throughput typically for file I/O. Applications developed using MapReduce or for Content Delivery Networks are such ones. – eagle Apr 10 '11 at 5:45
Might want to check out Apache's Hadoop. Adding link in my answer – Ryan Gibbons Apr 10 '11 at 16:15
feedback

Your Answer

 
or
required, but never shown
discard

Not the answer you're looking for? Browse other questions tagged or ask your own question.