Take the 2-minute tour ×
Server Fault is a question and answer site for system and network administrators. It's 100% free, no registration required.

I want to remove nodes from my cluster gracefully. I added the following to my hadoop-site.xml:

<property>
  <name>dfs.hosts.exclude</name>
  <value>/etc/hadoop/conf.dist/dfs.hosts.exclude</value>
  <final>true</final>
</property>

I'm adding a node to be removed to the file and executing

hadoop dfsadmin -refreshNodes

as root, but I get

refreshNodes: org.apache.hadoop.fs.permission.AccessControlException: Superuser privilege is required

The mod on the HDFS partition is 777.

Running Cloudera's hadoop-ec2 distribution, ver 0.18

share|improve this question

2 Answers 2

up vote 1 down vote accepted

have a look in ${HADOOP_CONF_DIR}/hadoop-policy.xml and see if the root has permissions to do that, root maybe superuser over the system, however may not be over the app.

Try thi link http://hadoop.apache.org/common/docs/current/service_level_auth.html

Stuart

share|improve this answer

The property dfs.hosts.exclude names a file that contains a list of hosts that are not permitted to connect to the namenode. The full pathname of the file must be specified.

Following link contains some info on how to start and stop datanode and tasktrackers. http://hadoop-blog.blogspot.com/2010/12/how-to-start-and-stop-datanodes-and.html

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.