amazon-rds

Moving data from S3 -> RDS using AWS Glue

↘锁芯ラ 提交于 2020-01-23 17:13:06
问题 Does AWS Glue provide ability to move data from S3 bucket to RDS database? I'm trying to setup serverless app that picks up dynamic data uploaded to S3 and migrates it to RDS. Glue provides Crawlers service that determines schema. Glue also provides ETL Jobs, but this seems to be where target source is only another S3 bucket. Any ideas? 回答1: Yes, Glue can send to an RDS datastore. If you are using the job wizard it will give you a target option of "JDBC". If you select JDBC you can setup a

Elastic Beanstalk -> RDS connection error using Grails

岁酱吖の 提交于 2020-01-23 12:06:06
问题 I'm deploying a Grails application to Amazon Web Services Elastic Beanstalk and leveraging RDS. I'm using Grails, Spring-Security (RDS tables). The application appears to work fine (login and data in RDS being pulled back). However, from time to time the first time I login I get a database connection error. The second time it (immediately) works fine. The only thing I'm doing slightly different is trying to use Java system properties for the connection string, username and password to

Elastic Beanstalk -> RDS connection error using Grails

别来无恙 提交于 2020-01-23 12:05:10
问题 I'm deploying a Grails application to Amazon Web Services Elastic Beanstalk and leveraging RDS. I'm using Grails, Spring-Security (RDS tables). The application appears to work fine (login and data in RDS being pulled back). However, from time to time the first time I login I get a database connection error. The second time it (immediately) works fine. The only thing I'm doing slightly different is trying to use Java system properties for the connection string, username and password to

CloudFormation : Template RDS Mysql to Create DB, Tables, User, or Load Schema

家住魔仙堡 提交于 2020-01-23 05:26:55
问题 Using CloudFormation, I'm trying to figure out a few use cases. The first case is having an existing AWS RDS MySQL server, how to create a database, tables, and a user account though a CloudFormation template. After looking at the Cloudformation docs, I thought there could be a AWS::RDS::DBInstance property that would allow me to do this action; however, though I couldn't find how to specify a database host source (or I may have misread it) that would allow. aws-properties-rds-database

Unable to connect on AWS - RDS DB : SQL Server 2012 Express

拈花ヽ惹草 提交于 2020-01-23 04:39:34
问题 I'm new in AWS world. I have an issue to access to my instance of Microsoft SQL Server 2012 Express (11.00.5058) on RDS (US-East-1a). When I have created DB instance, I was able to access to it, create some tables, transfer data, etc.. everything worked fine ! I didn't change anything and few hours after some inactivity, I try to access to the SQL Server instance by using Microsoft SQL Server Enterprise Manager but I was not able to connect to it anymore. I got following message: Cannot

IAM Database Authentication - How to use CLI generated Token

白昼怎懂夜的黑 提交于 2020-01-22 18:54:45
问题 I'm following http://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/UsingWithRDS.IAMDBAuth.html in order to authenticate from an EC2 to RDS. I am able to run the generate-db-auth-token command to retrieve a token, but I'm not sure what to do with it after that (the instructions inexplicably end). I've tried simply passing the regurgitated string (as well as logical substrings of the returned fields) as the password of a mysql client connection, but this doesn't seem to work.. The returned

How to query any table of RDS using Golang SDK

不羁的心 提交于 2020-01-16 10:16:10
问题 I am writing an AWS lambda to query 10 different tables from RDS(SQL Server) using Golang SDK. What I have learned so far is we have to create a similar struct for the table to query it. But as I want to query 10 tables, So I don't want to create the struct for every table, even the table schema may get changed someday. Lately, I want to create a CSV file per table as the backup with the queried data and upload it to S3. So is it possible to directly import the CSV file into a lambda, so that

MySQL Amazon RDS: Lock Wait timeout exceeded

北慕城南 提交于 2020-01-15 03:04:28
问题 On Mysql (Amazon RDS), when I try to run the following SQL query UPDATE table1 INNER JOIN table2 USING (CommonColumn) SET table1.col1 = table2.x, table1.col2 = table2.y I get this error after around 52 seconds consistently: Error Code: 1205. Lock wait timeout exceeded; try restarting transaction How should I resolve this? table2 has around 17 million records and table2 which is a subset of table1 has 4 million records. Could it be the size of the tables that is the problem or is something

RDS server backup

廉价感情. 提交于 2020-01-14 18:51:22
问题 Intention is to export RDS and load data to local mssql DB. Getting below errors when trying to backup rds server. SQL Statement used to initiate: USE [msdb] GO DECLARE @return_value int EXEC @return_value = [dbo].[rds_backup_database] @source_db_name = 'abcd', @S3_arn_to_backup_to = 'arn:aws:s3:::abcd/test_09_May.bak', @KMS_master_key_arn = NULL, @overwrite_S3_backup_file = NULL SELECT 'Return Value' = @return_value GO Query to check status: exec msdb.dbo.rds_task_status EXEC msdb.dbo.rds

Import mysql database to RDS

不羁的心 提交于 2020-01-14 07:56:25
问题 It took already 12 hours, I try to import a sql file to RDS, I use this command : mysqldump -u <user> -h <rds_server> -p <database> < filename.sql But nothing works and as result, I have this error -- MySQL dump 10.13 Distrib 5.7.22, for Linux (i686) -- -- Host: xxxxxxxxxx.us-east-2.rds.amazonaws.com Database: xxxxxxxxxx -- ------------------------------------------------------ -- Server version 5.6.39-log /*!40101 SET @OLD_CHARACTER_SET_CLIENT=@@CHARACTER_SET_CLIENT */; /*!40101 SET @OLD