Problem with copying local data onto HDFS on a Hadoop cluster using Amazon EC2/ S3

后端 未结 4 640
情深已故
情深已故 2020-12-31 19:01

I have setup a Hadoop cluster containing 5 nodes on Amazon EC2. Now, when i login into the Master node and submit the following command

bin/hadoop jar 

        
4条回答
  •  鱼传尺愫
    2020-12-31 19:26

    Use

    -Dfs.s3n.awsAccessKeyId= -Dfs.s3n.awsSecretAccessKey=
    

    e.g.

    hadoop distcp -Dfs.s3n.awsAccessKeyId= -Dfs.s3n.awsSecretAccessKey= - 
    

    or

    hadoop fs -Dfs.s3n.awsAccessKeyId= -Dfs.s3n.awsSecretAccessKey= - 
    

提交回复
热议问题