New answers tagged hadoop
Accumulo doesn't bundle a version of the ZooKeeper jar in its distribution because you already have that jar installed due to having ZooKeeper also installed as a prerequisite. The path to ZOOKEEPER_HOME is used to add this jar to the Accumulo classpath.
The Hyper-V machine that I've configured uses an External Virtual Switch that has a dynamic IP, but only when the box is initially brought up by "vagrant up" - if I destroy the box and remake, I get a new IP, but until then, it stays the same. Setting it up like this gives my host machine, and the VM internet access, and I can hit my vm from my host to ...
I usually use hdfs fuse mounts.. so can use almost any regular Unix commands (some of the commands may not work as hdfs is not POSIX-compliant filesystem). gunzip/zcat $ gunzip /hdfs_mount/dir1/somefile.gz $ grep hi /hdfs_mount/dir1/somefile.gz works just fine on hdfs fuse mounts. And faster to type too :) , easier to read if e.g. you want to script ...
In order to check your available quotas, from your Developer console you can go to Compute Engine->VM Instances->Quotas page. This page will give you the quota information for Google Compute Engine. You can refer to this answer in order to troubleshoot your Hadoop ssh issue.
As mentioned, problem is solved by setting the real Java location instead of a link to it, to find it: (Replace the path of 2,3 with the result of the previous one) $ which java $ ls -alh /usr/bin/java $ ls -alh /etc/alternatives/java Now you can set that in your .bashrc or .profile or wherever you need it. export JAVA_HOME=/usr/lib/jvm/java-8-oracle ...
I ended up having to delete the files with bad blocks, which after further investigation, I realized had a very low replication (rep=1 if I recall correctly). This SO post has more information on finding the files with bad blocks, using something along the lines of: hadoop fsck / | egrep -v '^\.+$' | grep -v eplica So, to answer my own questions: Can ...
Top 50 recent answers are included