I have a single node (pseudo-distributed config) and I'm considering adding a 2nd slave node. Does it matter if the slave has less HD capacity ? Will the rebalance take of that for itself. I'm not an HADOOP expert by far.
migrated from stackoverflow.com Jun 2 '11 at 17:53
This question came from our site for professional and enthusiast programmers.
No it doesn't matter but HDFS will not redistribute the blocks to the new node automatically so you will have to do that on your side. The easiest way is to run
Check this question on the Hadoop FAQ for more ways to rebalance.
|show 1 more comment|
Hadoop will balance the load. In addition you can set "dfs.replication" property to set the number of replications you want.