amazon-web-services

AWS InterruptedException: sleep interrupted com.amazonaws.http.IdleConnectionReaper

别等时光非礼了梦想. 提交于 2021-02-09 20:49:32
问题 we have a web application use AWS (Amazone api), in the coreConfiguration class we create a awsApi bean with predestroy method, the code for coreConfiguration is: @Bean(destroyMethod = "destroy") public IGridStorageManager awsApi() { ..... } in awsApi class we have detroy methode, the code is: @Override @PreDestroy public void destroy() { if (clientS3 != null) { clientS3.shutdown(); } } My problem is sometime in PROD when i use the API i see thos logs: 2020-08-03 11:27:00.090 DEBUG 25172 ---

EMR 5.21 , Spark 2.4 - Json4s Dependency broken

霸气de小男生 提交于 2021-02-09 20:45:01
问题 Issue In EMR 5.21 , Spark - Hbase integration is broken. df.write.options().format().save() fails. Reason is json4s-jackson version 3.5.3 in spark 2.4 , EMR 5.21 it works fine in EMR 5.11.2 , Spark 2.2 , son4s-jackson version 3.2.11 Problem is this is EMR so i cant rebuild spark with lower json4s . is there any workaround ? Error py4j.protocol.Py4JJavaError: An error occurred while calling o104.save. : java.lang.NoSuchMethodError: org.json4s.jackson.JsonMethods$.parse(Lorg/json4s/JsonInput;Z

AWS InterruptedException: sleep interrupted com.amazonaws.http.IdleConnectionReaper

房东的猫 提交于 2021-02-09 20:41:20
问题 we have a web application use AWS (Amazone api), in the coreConfiguration class we create a awsApi bean with predestroy method, the code for coreConfiguration is: @Bean(destroyMethod = "destroy") public IGridStorageManager awsApi() { ..... } in awsApi class we have detroy methode, the code is: @Override @PreDestroy public void destroy() { if (clientS3 != null) { clientS3.shutdown(); } } My problem is sometime in PROD when i use the API i see thos logs: 2020-08-03 11:27:00.090 DEBUG 25172 ---

AWS System Manager Parameter Store vs Secrets Manager vs Environment Variation in Lambda, when to use which

不打扰是莪最后的温柔 提交于 2021-02-09 18:02:37
问题 Encountered a few speicific use cases that I'm somewhat confused to use which: A large number of free, public API keys. Using lambda environment variable with encyption, other developer/admin can still expose their plaintext value right in the lambds console. Should Parameter Store be used instead? Login credentials to a third party platform. I assume that Secrets Manager is the only option? DB Connection strings. Secrets Manager? At $0.40/secret/month, the bill would add up for hundreds of

AWS System Manager Parameter Store vs Secrets Manager vs Environment Variation in Lambda, when to use which

核能气质少年 提交于 2021-02-09 18:01:39
问题 Encountered a few speicific use cases that I'm somewhat confused to use which: A large number of free, public API keys. Using lambda environment variable with encyption, other developer/admin can still expose their plaintext value right in the lambds console. Should Parameter Store be used instead? Login credentials to a third party platform. I assume that Secrets Manager is the only option? DB Connection strings. Secrets Manager? At $0.40/secret/month, the bill would add up for hundreds of

AWS System Manager Parameter Store vs Secrets Manager vs Environment Variation in Lambda, when to use which

只谈情不闲聊 提交于 2021-02-09 17:59:41
问题 Encountered a few speicific use cases that I'm somewhat confused to use which: A large number of free, public API keys. Using lambda environment variable with encyption, other developer/admin can still expose their plaintext value right in the lambds console. Should Parameter Store be used instead? Login credentials to a third party platform. I assume that Secrets Manager is the only option? DB Connection strings. Secrets Manager? At $0.40/secret/month, the bill would add up for hundreds of

AWS System Manager Parameter Store vs Secrets Manager vs Environment Variation in Lambda, when to use which

五迷三道 提交于 2021-02-09 17:59:37
问题 Encountered a few speicific use cases that I'm somewhat confused to use which: A large number of free, public API keys. Using lambda environment variable with encyption, other developer/admin can still expose their plaintext value right in the lambds console. Should Parameter Store be used instead? Login credentials to a third party platform. I assume that Secrets Manager is the only option? DB Connection strings. Secrets Manager? At $0.40/secret/month, the bill would add up for hundreds of

Cant unmarshall dynamodb attribute

眉间皱痕 提交于 2021-02-09 11:47:22
问题 I'm experimenting with AWS-SDK-GO with the DynamoDB API... I'm trying to query the db and return a string. But I'm having some issues unmarshelling the return value.... struct type Item struct { slug string destination string } query function input := &dynamodb.GetItemInput{ Key: map[string]*dynamodb.AttributeValue{ "slug": { S: aws.String(slug), }, }, TableName: db.TableName, } result, err := db.dynamo.GetItem(input) if err != nil { return "", err } n := Item{} err = dynamodbattribute

How pass json value for admin-update-user-attributes operation via cli in aws?

让人想犯罪 __ 提交于 2021-02-09 11:19:34
问题 Consider the example: aws cognito-idp admin-update-user-attributes --user-pool-id myUserPollId --username myUser --user-attributes [{"Name": "custom:roles","Value": "ROLE1,ROLE2"}] --region us-east-1 This gets me error: Invalid JSON: [{Name: 回答1: You can always try using shorthand syntax: --user-attributes Name="custom:roles",Value="ROLE1,ROLE2" If you really want to use the JSON syntax, try this: --user-attributes '[{"Name" : "custom:roles","Value" : "ROLE1,ROLE2"}]' Ensure that the user

How pass json value for admin-update-user-attributes operation via cli in aws?

醉酒当歌 提交于 2021-02-09 11:19:07
问题 Consider the example: aws cognito-idp admin-update-user-attributes --user-pool-id myUserPollId --username myUser --user-attributes [{"Name": "custom:roles","Value": "ROLE1,ROLE2"}] --region us-east-1 This gets me error: Invalid JSON: [{Name: 回答1: You can always try using shorthand syntax: --user-attributes Name="custom:roles",Value="ROLE1,ROLE2" If you really want to use the JSON syntax, try this: --user-attributes '[{"Name" : "custom:roles","Value" : "ROLE1,ROLE2"}]' Ensure that the user