Where is the configuration file for HDFS in Hadoop 2.2.0?

Question

I\'m studying Hadoop and currently I\'m trying to set up an Hadoop 2.2.0 single node. I downloaded the latest distribution, uncompressed it, now I\'m trying to set up the Ha

Answer 1

These files are all found in the hadoop/conf directory.

For setting HDFS you have to configure core-site.xml and hdfs-site.xml.

HDFS works in two modes: distributed (multi-node cluster) and pseudo-distributed (cluster of one single machine).

For the pseudo-distributed mode you have to configure:

In core-site.xml:

  fs.default.name
  hdfs://localhost:8020

In hdfs-site.xml:

<-- storage directories for HDFS - the hadoop.tmp.dir property, whose default is /tmp/hadoop-${user.name} -->

    hadoop.tmp.dir
    /your-dir/

Each property has its hardcoded default value.

Please remember to set ssh password-less login for hadoop user before starting HDFS.

P.S.

It you download Hadoop from Apache, you can consider switching to a Hadoop distribution:

Cloudera's CDH, HortonWorks or MapR.

If you install Cloudera CDH or Hortonworks HDP you will find the files in /etc/hadoop/conf/.