AWS Kinesis Firehose not inserting data in Redshift

后端 未结 4 1711
Happy的楠姐
Happy的楠姐 2020-12-08 05:46

I try to have a Kinesis Firehose pushing data in a Redshift table.

The firehose stream is working and putting data in S3.

But nothing arrive in the destinati

4条回答
  •  Happy的楠姐
    2020-12-08 06:31

    Wanted to post my case for anyone who's lost here.

    We were enforcing server-side encryption calls to our S3 bucket via the directions posted here: http://docs.aws.amazon.com/AmazonS3/latest/dev/UsingServerSideEncryption.html

    The problem with using this policy on a bucket that Firehose uses is that Firehose creates unencrypted manifest files as well as encrypted data files. If this policy is in place, the manifest files will not be created on S3 and thus, will not trigger the Redshift loads. So our behavior showed data arriving to the bucket, but no manifest files, ergo no data loads.

提交回复
热议问题