We would like to migrate from MySQL to Hadoop for scalability. Will hadoop clusters running on virtual machines improve our website's performance?

What are the advantages and disadvantages of implementing hadoop cluster on virtual machines(ESXi).

closed as primarily opinion-based by growse, Sven Dec 12 '14 at 11:52

Many good questions generate some degree of opinion based on expert experience, but answers to this question will tend to be almost entirely based on opinions, rather than facts, references, or specific expertise. If this question can be reworded to fit the rules in the help center, please edit the question.


Hadoop is a scalable data processing platform. MySQL is a relational database for realtime usage.

HBase (running on HDFS --> Hadoop Distributed File System) is a BigTable implementation: Big tables but not relational!

Can you map your application into these constraints? Only if you can do this mapping then the question of "will it perform" is a useful question.


Jonar No, you cannot use Hadoop. Hadoop and tools built on hadoop like Pig and Hive are good choices for backend processes where throughput matters more than response time. Since you want to power a website, I am asuuming that you need subsecond response times, nothing beats RDBMS for that. Hadoop will be slow for you even if you use dedicated machines. Virtual machines will not add any value for you

As Niels has mentioned, you can use Hbase but chances are very high that you will not be easily able to adapt your MySql processes to Hbase so I will encourage you to understand Hbase and know its limitations.

Not the answer you're looking for? Browse other questions tagged or ask your own question.