amazon-rds

AWS lambda function with runtime python 3.7 does not utilizing connection pool in rds proxy instead it create new connection on every request

本秂侑毒 提交于 2021-02-20 03:42:28
问题 I am using AWS lambda functions for a few months now. so far I have cached the connection in the lambda function memory to reuse. After reading about AWS rds proxy recently, I am trying to utilize the connection pool for the lambda functions(Runtime python3.7). so to test the way rds proxy works with lambda functions, I created two functions with runtime node12 and python3.7, the behaviours was this. 1. node12 function => When I run this function, it pools two connection in the proxy and

20-30 concurrent mysql connections causes RDS to spike above 80%

给你一囗甜甜゛ 提交于 2021-02-20 00:20:34
问题 So We have an Amazon RDS server running with the following specs. Instance Class: r3.xlarge My issue is when the MySQL server experiences multiple concurrent connections (connections in range of 30-40), The CPU reaches its peak. However according to the monitoring stats, it should be able to handle connections well above that. Here is the output for mysqltuner >> MySQLTuner 1.7.1 - Major Hayden <major@mhtx.net> >> Bug reports, feature requests, and downloads at http://mysqltuner.com/ >> Run

PostgreSQL Primary Key sequence lost after migration using AWS DMS

放肆的年华 提交于 2021-02-19 07:45:12
问题 I recently migrated a self hosted Postgres database to AWS RDS using the AWS Migration Service. Postgres Version: 10.6 I have noticed that all of my primary keys are no longer set to "sequence", and when I attempt to manually add a sequence it starts at 1 instead of continuing the count that is already set. I use Rails with the database, so my sql skills are pretty low. I can generally find my way around inserts and updates, but this is not a realm I have much experience in. My question has 2

AWS Fargate connection to RDS in a different VPC

被刻印的时光 ゝ 提交于 2021-02-19 05:40:48
问题 I have following setup: ECS (Fargate) cluster in VPC-1 RDS in VPC-2 My application running in ECS uses DNS name to connect to RDS however instead of private IP DNS resolves public IP address. In RDS I want to configure strict security rules to prevent connections from the outside world - I would like to limit it to only accept connections from VPC-1. I tried following things: peering both VPC-1 and VPC-2 - doesn't help, app running in ECS still resolves public IP routing all outbound traffic

Aurora Serverless password rotation setup using CloudFormation (and Lambda rotation templates)

杀马特。学长 韩版系。学妹 提交于 2021-02-19 03:20:00
问题 AWS has Fully Configured and Ready-to-Use Rotation Support for some supported RDS engines, including Amazon Aurora (Serverless also?) I'm trying to setup the password rotation in my CloudFormation template using AWS::SecretsManager::RotationSchedule (note that this is not a fully functional template, only an illustration): DBCluster: Type: AWS::RDS::DBCluster Properties: Engine : aurora EngineMode : serverless EngineVersion : 5.6.10a Secret: Type: AWS::SecretsManager::Secret Properties:

Synchronize Amazon RDS with Google BigQuery

旧巷老猫 提交于 2021-02-19 00:45:58
问题 People, the company where I work has some MySQL databases on AWS (Amazon RDS). We are making a POC with BigQuery and what I am researching now is how to replicate the bases to BigQuery (the existing registers and the new ones in the future). My doubts are: How to replicate the MySQL tables and rows to BigQuery. Is there any tool to do that (I am reading about Amazon Database Migration Service)? Should I replicate to Google Cloud SQL and than export to BigQuery? How to replicate the future

Synchronize Amazon RDS with Google BigQuery

非 Y 不嫁゛ 提交于 2021-02-19 00:40:09
问题 People, the company where I work has some MySQL databases on AWS (Amazon RDS). We are making a POC with BigQuery and what I am researching now is how to replicate the bases to BigQuery (the existing registers and the new ones in the future). My doubts are: How to replicate the MySQL tables and rows to BigQuery. Is there any tool to do that (I am reading about Amazon Database Migration Service)? Should I replicate to Google Cloud SQL and than export to BigQuery? How to replicate the future

Most efficient way to clone an AWS RDS database?

浪尽此生 提交于 2021-02-18 22:46:54
问题 I have 2 MySQL databases running on a server called X and Y, which both have identical content. A series of updates run throughout the day, which changes the content of X. At the end of the day, a process runs that compares the content of X with the content of Y (for various tables) in order to discover new rows, updated row data etc. Once the updates have been processed, mysqldump is used to dump X and then Y is overwritten with the dump. Both X and Y are now the same again, and the whole

Most efficient way to clone an AWS RDS database?

喜你入骨 提交于 2021-02-18 22:44:34
问题 I have 2 MySQL databases running on a server called X and Y, which both have identical content. A series of updates run throughout the day, which changes the content of X. At the end of the day, a process runs that compares the content of X with the content of Y (for various tables) in order to discover new rows, updated row data etc. Once the updates have been processed, mysqldump is used to dump X and then Y is overwritten with the dump. Both X and Y are now the same again, and the whole

AWS EB undefined RDS_HOSTNAME with Database hosts array empty

百般思念 提交于 2021-02-11 14:40:02
问题 Currently in a Laravel project using AWS EB with RDS. When I run php artisan migrate --seed then I get PHP Notice: Undefined index: RDS_HOSTNAME in /var/app/current/config/database.php on line 5 PHP Notice: Undefined index: RDS_USERNAME in /var/app/current/config/database.php on line 6 PHP Notice: Undefined index: RDS_PASSWORD in /var/app/current/config/database.php on line 7 PHP Notice: Undefined index: RDS_DB_NAME in /var/app/current/config/database.php on line 8 and Database hosts array is