Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

Is anyone aware of any sandbox where an environment is already set up for big data processing?

It can be hadoop, cassandra, pig etc...

I'm a sql server programmer, and trying to get into big data/nosql solutions, but having a very difficult time trying to set up my own environment in linux.

Are there any free/paid services that allow you to upload your big data and play with it and set up clustering?

share|improve this question

closed as not constructive by Michael Hampton, mdpc, Ladadadada, mfinni, Dave M Dec 31 '12 at 18:27

As it currently stands, this question is not a good fit for our Q&A format. We expect answers to be supported by facts, references, or expertise, but this question will likely solicit debate, arguments, polling, or extended discussion. If you feel that this question can be improved and possibly reopened, visit the help center for guidance.If this question can be reworded to fit the rules in the help center, please edit the question.

1 Answer 1

Amazon, Windows Azure.

You can easily get 100 or 1000 virtual machiens for a short time.

The problem with any such external thing is that "big data" is hard to move. Lots of processing is easy, but how do you get terabytes of data to Amazon for a test?

share|improve this answer
    
great point regarding moving it! i would like experience with the processing part, so i would only move maybe a few gigs! can you point me exactly where on amazon this can be done? –  Yuck Dec 31 '12 at 17:16
    
THe problem with that is - that - hm - seriously - depending WHAT do you, you may not do anything then. I mean, if you need 100 hadoop instances for handling large data, what sense is having 1gb distributed? –  TomTom Dec 31 '12 at 17:16
    
Anyhow, any cloud (amazon) does that. And how challenging is it for you to type "amazon hpc" into google? –  TomTom Dec 31 '12 at 17:16
    
regarding your first response, i just want to learn. is there any harm in doing what im doing? would i not learn anything? –  Yuck Dec 31 '12 at 17:19
    
Likey not learn anything. THat is the problem - big data ASSUMES big data, many things make no sense if you dont ahve a lot of data. I run a HPC system in my basement, if that would "test" with a handfull of gigabyte, there would not be enough jobs ;) –  TomTom Dec 31 '12 at 17:26

Not the answer you're looking for? Browse other questions tagged or ask your own question.