Server Fault is a question and answer site for system and network administrators. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

I am installing Hadoop 1.1.2 on CentOS 6.4.

I read all the Hadoop documentation at

After installing, I noticed there are many shell scripts at /usr/sbin/. But the documentation does not explain what most of these do.

For example:

Is there some supplemental documentation to get an explanation of these scripts?

share|improve this question sets up the named user's home directory in HDFS under the /user path. is used to bootstrap the cluster configuration on a new cluster. is used to format the HDFS structure and create the standard directory tree inside HDFS. This is a destructive tool and could cause bad things to occur on an existing cluster, such as dataloss. is for setting up a single node deployment, often known as a pseudo-distributed cluster. This causes all necessary daemons to run under one system. runs teragen, terasort, and teravalidate as a way to smoketest your cluster and make sure it's running properly. It's a basic benchmark. allows you to run a command on all slaves in a cluster (basically, the datanodes). runs hadoop balancer, which causes the namenode to shuffle blocks around on the datanodes in order to make sure all datanodes are using a (roughly) equal amount of disk space. This is a housekeeping task that should be run periodically. is the tool to start up the jobhistory server, which provides information on the jobs that have been run on the mapreduce side of the cluster. and are the opposite of the above two. updates the script, which is used to set up common environment variables needed by all hadoop tools and daemons in the cluster.

There's not really much in the way of documentation for some of this stuff. You just need to dig around in the scripts to see what they're really doing.

share|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.