Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

I'm going to build a cluster lab to test solutions and new applications for use in a larger cluster considered to be highly available, scalable and fault tolerant. I want to know available open source solutions for such a cluster lab, any proposal or comment is appreciated.

share|improve this question

closed as off topic by sysadmin1138 Aug 9 '12 at 17:12

Questions on Server Fault are expected to relate to professional server, networking, or related infrastructure administration within the scope defined by the community. Consider editing the question or leaving comments for improvement if you believe the question can be reworded to fit within the scope. Read more about reopening questions here.If this question can be reworded to fit the rules in the help center, please edit the question.

    
Product and service recommendations are off topic per the updated FAQ. –  sysadmin1138 Aug 9 '12 at 17:12
add comment

1 Answer

There are quite a few different solutions you could go with, depending on what you ultimately are trying to accomplish ( and I would even try to pick one that mimics the big one)

Most common might be Beowulf Clusters. Other Parrellel ones are PVM or MPICH2. Or you can even custom write some software that offloads task to a set of known machines. (I know Gentoo does this with distcc to distribute the task of compiling software).

I think it really depends on what you are trying to do / mimic.

For data intensive, check out Apache's Hadoop it's an open-source project of utilities, file system and mapreduce implementation

share|improve this answer
    
My applications will be data-intensive and optimised to have high throughput typically for file I/O. Applications developed using MapReduce or for Content Delivery Networks are such ones. –  eagle Apr 10 '11 at 5:45
    
Might want to check out Apache's Hadoop. Adding link in my answer –  Ryan Gibbons Apr 10 '11 at 16:15
add comment

Not the answer you're looking for? Browse other questions tagged or ask your own question.