AWS Glue to Redshift: Is it possible to replace, update or delete data?

后端 未结 6 1917
执念已碎
执念已碎 2020-12-25 12:33

Here are some bullet points in terms of how I have things setup:

  • I have CSV files uploaded to S3 and a Glue crawler setup to create the table and schema.
6条回答
  •  爱一瞬间的悲伤
    2020-12-25 13:10

    As per my testing (with the same scenario), the BOOKMARK functionality is not working. Duplicate data is getting inserted when the Job is run multiple times. I have got this issue resolved by removing the files from the S3 location daily (through lambda) and implementing Staging & Target tables. data will get insert/update based on the matching key columns.

提交回复
热议问题