amazon-s3

问题 I am trying to run a job on an AWS EMR cluster. The problem Im getting is the following: aws java.io.IOException: No FileSystem for scheme: hdfs I dont know where exactly my problem resides (in my java jar job or in the configurations of the job) In my S3 bucket Im making a folder (input) and in it im putting a bunch of files with my data. Then in the arguments Im giving the path for the input folder which then same path is used as the FileInputPath.getInputPath(args[0]). My question is -

问题 I'm using Mac High Sierra. I'm tryhign to install Amazon's S3 cli tools. I thought I had installed successfully through pip, but then I got this error tryihng to run an s3 command ... localhost:~ davea$ s3cmd --recursive ls s3://sbdasset.springboardonline.com | grep "resource" -bash: /usr/local/bin/s3cmd: /usr/local/opt/python/bin/python2.7: bad interpreter: No such file or directory Per the answer here -- pip installation /usr/local/opt/python/bin/python2.7: bad interpreter: No such file or

问题 I'd like to have an AWS lambda triggered when a tag is added to an existing object in S3 bucket (in the same way as we can do it for object create and remove). Any way to do that? 回答1: If you setup Cloudtail you could have a Lambda function monitor the logs and notify you on the tagging event PutBucketTagging Example Lambda function https://github.com/retailnext/aws-lambda-cloudtrail-alert Cloudtail Documentation http://docs.aws.amazon.com/awscloudtrail/latest/userguide/cloudtrail-user-guide

问题 This problem has been driving me nuts for two days now. The objective: Upload an image directly from the browser to S3 via a pre-signed URL supplied by the getSignedUrl function in the AWS Javascript SDK. I haven't had any problems generating URLs with getSignedUrl. The following code... const params = { Key: key, Bucket: process.env.S3_BUCKET, ContentType: "image/jpeg" }; S3.getSignedUrl("putObject", params, callback); ...yields something like: https://s3.amazonaws.com/foobar-bucket

问题 My setup: I have a Cloudfront Origin Group where Bucket A is a primary bucket and Bucket B is a secondary bucket. Lambda@Edge is added on origin-request to do a certain process. Whenever a request comes to Cloudfront, my Lambda@Edge modifies it to match the folder structure of my bucket and returns file accordingly. If Bucket A doesn't have a certain file it throws an error and Cloudfront failover requests the file from Bucket B. Bucket B doesn't have the same structure as Bucket it, it

问题 I want to delete AWS S3 Object according to the time of creation using Nodejs Lambda function. I want to delete all objects in a particular folder which are created before 24 hour Now I have tried to delete multiple object which is success but I dnt know how to do it with time var params = { Bucket: s3bucket, Delete: { Objects: [ { Key: 'scheduled_lambda_test/1.png' }, { Key: 'scheduled_lambda_test/2.png' } ] } }; s3.deleteObjects(params, function(err, data) { if (err) console.log(err, err

问题 I'm using Nodejs to try and push an image to an S3 instance with the aws-sdk. Currently, it reads from a file on the client and then saves it on the server (I'm using a meteor framework.) I'd like to push it to the S3 server instead of saving it on the meteor server. When I tried to migrate it over, the images seem to gain about 30% when they are on S3. If I try and download them off of S3 the image is no longer viewable either, so it looks like it has changed encoding or something. Here is

问题 First I'm trying to copy the file into other folder and unable to delete it. How I can delete the file only if the file is copied to the destination folder. const s3Params = { Bucket: bucket, CopySource: bucket + '/' + objectkey, Key: 'processed-data/' + objectkey }; function copyFile() { s3.copyObject(s3Params, function (err, data) { if (err) { console.log(err); } else { deleteFile(); } }); } function deleteFile() { s3.deleteObject(s3Params, function (err, data) { if (err) { console.log(err,

问题 I'm trying to make use of the AWS S3 storage to store images for a mobile app, but I'm not able to compile my app. I have the .jar files in my libs directory. In the dependencies section of my build.gradle file I have: dependencies { compile "com.amazonaws.services.s3:1.6.1" } I've tried every combination I can think of. com.amazonaws.services.s3:1.6.1, com.amazonaws.services:s3:1.6.1, com.amazonaws:services:1.6.1...but I always get an error about that says Could not find com.amazonaws

问题 I'm using Delayed Paperclip alongside direct uploads to S3. My model is called Photo and its attachment is image . Images are uploaded to S3 using JavaScript from the Photo form. The file is stored in the location that Paperclip expects the original image to be located, and the file details are saved to hidden fields. When the form is submitted, these attributes are written to the Photo model: image_file_name image_file_size image_content_type Because writing these attributes alone doesn't