amazon-ecs

boto3 can't connect to S3 from Docker container running in AWS batch

a 夏天 提交于 2020-05-29 10:43:50
问题 I am attempting to launch a Docker container stored in ECR as an AWS batch job. The entrypoint python script of this container attempts to connect to S3 and download a file. I have attached a role with AmazonS3FullAccess to both the AWSBatchServiceRole in the compute environment and I have also attached a role with AmazonS3FullAccess to the compute resources. This is the following error that is being logged: botocore.exceptions.ConnectTimeoutError: Connect timeout on endpoint URL: "https://s3

Operating the Celery Worker in the ECS Fargate

荒凉一梦 提交于 2020-05-27 04:34:27
问题 I am working on a project using AWS ECS. I want to use Celery as a distributed task queue. Celery Worker can be build up as EC2 type, but because of the large amount of time that the instance is in the idle state, I think it would be cost-effective for AWS Fargate to run the job and quit immediately. Do you have suggestions on how to use the Celery Worker efficiently in the AWS cloud? 回答1: Fargate launch type is going to take longer to spin up than EC2 launch type, because AWS is doing all

Operating the Celery Worker in the ECS Fargate

别等时光非礼了梦想. 提交于 2020-05-27 04:31:52
问题 I am working on a project using AWS ECS. I want to use Celery as a distributed task queue. Celery Worker can be build up as EC2 type, but because of the large amount of time that the instance is in the idle state, I think it would be cost-effective for AWS Fargate to run the job and quit immediately. Do you have suggestions on how to use the Celery Worker efficiently in the AWS cloud? 回答1: Fargate launch type is going to take longer to spin up than EC2 launch type, because AWS is doing all

What's the target group port for, when using Application Load Balancer + EC2 Container Service

≡放荡痞女 提交于 2020-05-24 17:20:32
问题 I'm trying to setup an ALB which listens on port 443, load balancing to ECS Docker containers on random ports, lets say I have 2 container instances of the same task definition, listening on port 30000 and 30001. When I try to create a target group in the AWS EC2 Management console, there's a "port" input field with 1-65535 range. What number should I put there? And when I try to create a new service in the AWS EC2 Container Service console, together with a new target group to connect to a

How does “latest” tag work in an ECS task definition and container instances pulling from ECR?

时间秒杀一切 提交于 2020-05-15 02:52:12
问题 I'm having problems using latest tag in an ECR task definition, where image parameter has value like XXXXXXXXXXXX.dkr.ecr.us-east-1.amazonaws.com/reponame/web:latest . I'm expecting this task definition to pull an image with latest tag from ECR once a new service instance (task) is run on the container instance (an EC2 instance registered to the cluster). However in my case when I connect to the container instance remotely and list docker images, I can see that it has not pulled the latest

Aws ecs fargate ResourceInitializationError: unable to pull secrets or registry auth

人盡茶涼 提交于 2020-05-14 19:48:07
问题 I am trying to run a private repository on aws-ecs-fargate-1.4.0 platform. For private repository authentication, I have followed the docs and it was working well. Somehow after updating existing service many times it goes fail to run the task and complain the error like ResourceInitializationError: unable to pull secrets or registry auth: execution resource retrieval failed: unable to get registry auth from asm: service call has been retried 1 time(s): asm fetching secret from the service

Codepipeline: Insufficient permissions Unable to access the artifact with Amazon S3 object key

余生颓废 提交于 2020-05-06 19:55:27
问题 Hello I created a codepipeline project with the following configuration: Source Code in S3 pulled from Bitbucket. Build with CodeBuild, generating an docker image and storing it into a Amazon ECS repository. Deployment provider Amazon ECS. All the process works ok until when it tries to deploy, for some reason I am getting the following error during deployment: Insufficient permissions Unable to access the artifact with Amazon S3 object key 'FailedScanSubscriber/MyAppBuild/Wmu5kFy' located in

Force AWS library to obtain region from environment inside docker cluster

只愿长相守 提交于 2020-04-17 22:40:46
问题 I’m trying to test a Java app running in a docker container on my desktop. The app runs fine if I execute it directly from my command line, but it fails when I try to run it inside a Docker container on my desktop. The error output shows that the library is requesting region information, then failing with this error: com.amazonaws.SdkClientException: Unable to find a region via the region provider chain. Must provide an explicit region in the builder or setup environment to supply a region. I

AWS cluster not able to access resource present in container

感情迁移 提交于 2020-04-17 20:23:19
问题 I just created a cluster,task definition and a service.Container is running successfully but not able to access resource present in container.I am trying to access with Public DNS ipv4 getting This site can’t be reached ec2-xx-xx-xxx-xx.ap-south-1.compute.amazonaws.com refused to connect 来源: https://stackoverflow.com/questions/60101541/aws-cluster-not-able-to-access-resource-present-in-container

AWS cluster not able to access resource present in container

我是研究僧i 提交于 2020-04-17 20:23:03
问题 I just created a cluster,task definition and a service.Container is running successfully but not able to access resource present in container.I am trying to access with Public DNS ipv4 getting This site can’t be reached ec2-xx-xx-xxx-xx.ap-south-1.compute.amazonaws.com refused to connect 来源: https://stackoverflow.com/questions/60101541/aws-cluster-not-able-to-access-resource-present-in-container