I am setting up a Hadoop 2.6.0 Single Node Cluster. I follow the hadoop-common/SingleCluster documentation. I work on Ubuntu 14.04. So far I have m
Do these changes in /etc/hosts:
1. Change:
127.0.0.1 localhost
to
127.0.0.1 localhost marta-komputer
2. Delete:
127.0.0.1 marta-komputer
3. Add:
your-system-ip marta-komputer
To find your system IP, type this in terminal
ifconfig
(find your IP address here) or type this:
ifdata -pa eth0
Your final /etc/hosts file should look like:
127.0.0.1 localhost marta-komputer
your-system-ip marta-komputer
# The following lines are desirable for IPv6 capable hosts
::1 ip6-localhost ip6-loopback
fe00::0 ip6-localnet
ff00::0 ip6-mcastprefix
ff02::1 ip6-allnodes
ff02::2 ip6-allrouters
Change hdfs-site.xml:
1. Change:
hdfs://localhost:9000
to
hdfs://marta-komputer:9000
Now, stop and start hadoop processes.
Your jps command should list these processes:
Namenode
Datanode
TaskTracker
SecondaryNameNode
If it does not list all these processes, check respective logs for errors.
UPDATE:
Follow this tutorial here
If the problem persists, it might be due to permission issue.
UPDATE II:
sudo mkdir -p /usr/local/hdfs/namenode
sudo mkdir -p /usr/local/hdfs/datanode
sudo chown -R hduser:hadoop /usr/local/hdfs/namenode
sudo chown -R hduser:hadoop /usr/local/hdfs/datanode
hdfs-site.xml:dfs.datanode.data.dir with value /usr/local/hdfs/datanode
dfs.namenode.data.dir with value /usr/local/hdfs/namenode