Server Fault is a question and answer site for system and network administrators. It's 100% free, no registration required.

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I'm going to build a cluster lab to test solutions and new applications for use in a larger cluster considered to be highly available, scalable and fault tolerant. I want to know available open source solutions for such a cluster lab, any proposal or comment is appreciated.


locked by HopelessN00b Feb 4 '15 at 2:57

This question exists because it has historical significance, but it is not considered a good, on-topic question for this site, so please do not use it as evidence that you can ask similar questions here. This question and its answers are frozen and cannot be changed. More info: help center.

closed as off topic by sysadmin1138 Aug 9 '12 at 17:12

Questions on Server Fault are expected to relate to server, networking, or related infrastructure administration within the scope defined by the community. Consider editing the question or leaving comments for improvement if you believe the question can be reworded to fit within the scope. Read more about reopening questions here.If this question can be reworded to fit the rules in the help center, please edit the question.

Product and service recommendations are off topic per the updated FAQ. – sysadmin1138 Aug 9 '12 at 17:12

There are quite a few different solutions you could go with, depending on what you ultimately are trying to accomplish ( and I would even try to pick one that mimics the big one)

Most common might be Beowulf Clusters. Other Parrellel ones are PVM or MPICH2. Or you can even custom write some software that offloads task to a set of known machines. (I know Gentoo does this with distcc to distribute the task of compiling software).

I think it really depends on what you are trying to do / mimic.

For data intensive, check out Apache's Hadoop it's an open-source project of utilities, file system and mapreduce implementation

My applications will be data-intensive and optimised to have high throughput typically for file I/O. Applications developed using MapReduce or for Content Delivery Networks are such ones. – eagle Apr 10 '11 at 5:45
Might want to check out Apache's Hadoop. Adding link in my answer – Ryan Gibbons Apr 10 '11 at 16:15

Not the answer you're looking for? Browse other questions tagged or ask your own question.