How to specify AWS Access Key ID and Secret Access Key as part of a amazon s3n URL

Question

I am passing input and output folders as parameters to mapreduce word count program from webpage.

Getting below error:

HTTP Status 500 - Requ

Answer 1

Passing in the AWS Credentials as part of the Amazon s3n url is not normally recommended, security wise. Especially if that code is pushed to a repository holding service (like github). Ideally set your credentials in the conf/core-site.xml as:

  
    fs.s3n.awsAccessKeyId
    XXXXXX
  

  
    fs.s3n.awsSecretAccessKey
    XXXXXX
  

or reinstall awscli on your machine.

pip install awscli