amazon-s3

SSL validation failed for https://s3.zoneame.amazonaws.com/ [SSL: CERTIFICATE_ VERIFY_FAILED] certificate verify failed (_ssl.c:749)

我与影子孤独终老i 提交于 2020-01-06 06:47:56
问题 When I run the command aws s3 ls I'm getting this error: SSL validation failed for https://s3.zonename.amazonaws.com/ [SSL: CERTIFICATE_ VERIFY_FAILED] certificate verify failed (_ssl.c:749) It work's fine with --no-verify-ssl How can I make it work with ssl verficication? aws s3 ls --debug log below: Traceback (most recent call last): File "C:\Program Files\Amazon\AWSCLI\runtime\lib\site-packages\urllib3\connect ionpool.py", line 594, in urlopen self._prepare_proxy(conn) File "C:\Program

Move files from EC2 to S3 and then delete from EC2

僤鯓⒐⒋嵵緔 提交于 2020-01-06 06:44:28
问题 I'm migrating files from one remote server to S3. There are about 10k files (all accessible via http URLs from the remote server). The total size is about 300GB (no individual file is more than 1GB). I'm trying to figure out the most efficient way to make this migration. So far I have a EC2 instance and I have the S3CMD installed; PHP-SDK, I have a text file with all the URL's as well. I'm able to move files from EC2 to S3 without any issue. but the problem is if I download everything in EC2

Move files from EC2 to S3 and then delete from EC2

落爺英雄遲暮 提交于 2020-01-06 06:44:07
问题 I'm migrating files from one remote server to S3. There are about 10k files (all accessible via http URLs from the remote server). The total size is about 300GB (no individual file is more than 1GB). I'm trying to figure out the most efficient way to make this migration. So far I have a EC2 instance and I have the S3CMD installed; PHP-SDK, I have a text file with all the URL's as well. I'm able to move files from EC2 to S3 without any issue. but the problem is if I download everything in EC2

RoR: not able to connect paperclip to Amazon S3

我是研究僧i 提交于 2020-01-06 06:25:44
问题 I have decided to deploy my app to Heroku and I was following their tutorials. However, Im trying to connect to my Amazon S3 bucket with a paperclip plugin right now and Im getting this error: ArgumentError in Images#index Showing app/views/images/index.html.erb where line #19 raised: syntax error on line 0, col 39: `bucket: (MY BUCKET HERE) access_key_id: (MY ACCESS KEY ID HERE) secret_access_key: (MY SECRET ACCESS KEY HERE) ' Extracted source (around line #19): 16: <%=h image.created_at %>

Xhttp request always returns a 0 response code. - While making a post request using form data

让人想犯罪 __ 提交于 2020-01-06 06:06:50
问题 I am trying to upload an array of images using form data and xhttp. Client : React Native - Both platforms Server : Node running on GCP Images go into s3. Problem : Images are uploaded into s3. And when i look at my server logs i see the server is sending 200. But, client is always receiving response code 0. And also xhttp goes from state 1 -> 4. We have added CORS on both ends so that might not be an issue. I have accept and content headers. But, no idea what's going wrong. Any help is

ElasticSearch backup to S3 AWS

有些话、适合烂在心里 提交于 2020-01-06 06:01:14
问题 I'm trying to backup my cluster of ElasticSearch on AWS to an S3 bucket. I've followed the following 'tutorial' : Use Amazon S3 to Store a Single Amazon Elasticsearch Service Index These are the steps I have taken: Create a S3 bucket (called cb-search-es-backup). Create a new policy (called P_ES_SNAPSHOT_TO_S3): { "Statement": [ { "Action": [ "s3:ListBucket", "s3:GetBucketLocation", "s3:ListBucketMultipartUploads", "s3:ListBucketVersions" ], "Effect": "Allow", "Resource": [ "arn:aws:s3:::cb

Displaying image buffer from S3 in Angular view

风流意气都作罢 提交于 2020-01-06 05:50:16
问题 I am trying to display an image I fetched from S3 in my angular view. I am getting the image as buffer from S3. I have tried passing the buffer as img src but that did not help me in displaying image. import * as AWS from 'aws-sdk'; import * as S3 from 'aws-sdk/clients/s3'; @Component({ selector: "app-Mycomp", templateUrl: "mycomp.component.html" }) export class MyComponent implements OnInit { imageSrc : any; ngOnInit() { this.displayMyFile() } displayMyFile() { let accessKeyId = MyAccessKey

Configuring a Node.js application to work with Websockets over TCP as well as AWS S3

眉间皱痕 提交于 2020-01-06 05:31:08
问题 I'm working on a Node.js application and installing WebSockets to use with ParseLiveQuery. For the app to work in full, I need HTTPS access for S3, images, etc. and TCP access for the WebSocket. Below is my current setup: And my index.js file var S3Adapter = require('parse-server').S3Adapter; var s3Adapter = new S3Adapter( "myAppMediaServer", { directAccess: true, baseUrl: 'http://myApp12345.cloudfront.net' // This could be your CloudFront URL } ); var api = new ParseServer({ databaseURI:

Import pyspark dataframe from multiple S3 buckets, with a column denoting which bucket the entry came from

*爱你&永不变心* 提交于 2020-01-06 05:23:07
问题 I have a list of S3 buckets partitioned by date. The first bucket titled 2019-12-1, the second 2019-12-2, etc. Each of these buckets stores parquet files that I am reading into a pyspark dataframe. The pyspark dataframe generated from each of these buckets has the exact same schema. What I would like to do is iterate over these buckets, and store all of these parquet files into a single pyspark dataframe that has a date column denoting what bucket each entry in the dataframe actually came

Unable to delete S3 bucket

穿精又带淫゛_ 提交于 2020-01-06 04:56:10
问题 I created a s3 bucket using console, while configuration I removed the default selected user. Now when I am trying to delete the bucket using console it says access denied. I understand I should have removed the user. However when I click on bucket name in permission it show owner: myUserName and bucket policy: no How can I delete it? As I understand there is owner but there is no permission to owner as I removed it while configuration. 回答1: You can try this: Create a new Bucket(Do not change