Hadoop Pseudo-Distributed Operation error: Protocol message tag had invalid wire type

前端 未结 4 1777
一整个雨季
一整个雨季 2020-12-10 18:08

I am setting up a Hadoop 2.6.0 Single Node Cluster. I follow the hadoop-common/SingleCluster documentation. I work on Ubuntu 14.04. So far I have m

4条回答
  •  孤街浪徒
    2020-12-10 19:07

    Do these changes in /etc/hosts:

    1. Change:

    127.0.0.1    localhost
    

    to

    127.0.0.1    localhost    marta-komputer
    

    2. Delete:

    127.0.0.1    marta-komputer
    

    3. Add:

    your-system-ip    marta-komputer
    

    To find your system IP, type this in terminal

    ifconfig
    

    (find your IP address here) or type this:

    ifdata -pa eth0
    

    Your final /etc/hosts file should look like:

    127.0.0.1       localhost       marta-komputer
    your-system-ip       marta-komputer
    
    # The following lines are desirable for IPv6 capable hosts
    ::1     ip6-localhost ip6-loopback
    fe00::0 ip6-localnet
    ff00::0 ip6-mcastprefix
    ff02::1 ip6-allnodes
    ff02::2 ip6-allrouters
    

    Change hdfs-site.xml:

    1. Change:

    hdfs://localhost:9000
    

    to

    hdfs://marta-komputer:9000
    

    Now, stop and start hadoop processes.

    Your jps command should list these processes:

    Namenode
    Datanode
    TaskTracker
    SecondaryNameNode
    

    If it does not list all these processes, check respective logs for errors.

    UPDATE:

    1. Follow this tutorial here

    2. If the problem persists, it might be due to permission issue.

    UPDATE II:

    1. Create a directory and change permissions for namenode and datanode:

    sudo mkdir -p /usr/local/hdfs/namenode

    sudo mkdir -p /usr/local/hdfs/datanode

    sudo chown -R hduser:hadoop /usr/local/hdfs/namenode

    sudo chown -R hduser:hadoop /usr/local/hdfs/datanode

    1. Add these properties in hdfs-site.xml:

    dfs.datanode.data.dir with value /usr/local/hdfs/datanode

    dfs.namenode.data.dir with value /usr/local/hdfs/namenode

    1. Stop and start hadoop processes.

提交回复
热议问题