1

I have set up a hadoop 1.2.1 environment on centos 6. I also use nfs-proxy that mount ndfs to local file system so that I can access the files inside hdfs locally. It works perfectly until today, I was asked to integrate user authentication with LDAP. For some reason, I have to change the uid of some existing unix user and store those new uid in LDAP.

After the change, hdfs seems not able to get the new uid of user, i.e., when I put a new file to hdfs, it still use the old uid to store the file in hdfs. I know that because when I check the uid of the new file from local mounting point of hdfs, it shows the old uid. And I can not access the file on local file system since it belongs to different user.

I have test restart the hadoop but no effect. Any suggestion?

0

you have to make sure you are using the LDAP user. Check with id if u are actually the LDAP user and not a local user when writing the file.

By the way you write im taking you are trying to write from a different server. If so does this machine also use the LDAP or are you using a local account? because this user will use its own uid when writing the file.

things you can check:

  • /etc/nsswitch.conf for the order in which a machine uses files or ldap for retrieving account information
  • getent passwd to check if it even know the ldap user
  • my personal experience is avoid having an ldap user and local user with the same name. This causes for all kinds of awkard issues with UIDs / home directories / etc. So if have a local users with the same username in ldap you can consider removing them from the local machine. When I migrate a server to LDAP auth I always remove the local users.
  • Yes, I am pretty sure I now use LDAP user since I have delete the local user by 'userdel' command. And all machines in hdfs are using LDAP authentication as well. All your concerns are checked with no luck. Thanks anyway. – user1817188 Dec 19 '13 at 0:15
  • you have nscd running? it could be a cache issue perhaps. – Koen van der Rijt Dec 19 '13 at 9:21
  • No, I have only nslcd running. And I have restart it many times. – user1817188 Dec 27 '13 at 1:44
  • then im short of ideas dude.. im sorry I couldnt help. the only other thing I cant think of is mount options perhaps? but thats a long shot – Koen van der Rijt Dec 27 '13 at 9:44

Your Answer

By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

Not the answer you're looking for? Browse other questions tagged or ask your own question.