Exception in createBlockOutputStream when copying data into HDFS

Question

I am getting the below warning messages while copying the data into HDFS. I\'ve 6 node cluster running. Every time during copy it ignores the two nodes and displays the belo

Answer 1

In case you're using Fedora/CentOS, turn off the firewall by:

service firewalld stop

Answer 2

Make sure to check firewall

service iptables save

service iptables stop

chkconfig iptables off

More details on this blog: http://ahikmat.blogspot.kr/2014/05/three-essential-things-to-do-while.html

Answer 3

You need to open up your TCP ports for the nodes that you cannot connect to.

Solution: Add TCP port range 0-65535 to the security group to fix the problem.