AWS Redshift UNLOAD not firing S3 PUT event

I am trying to use Redshift to UNLOAD data to S3 and then pick that data up with a Lambda function and process it. All of the constituent parts (the UNLOAD, the Lambda function) now work, however the Lambda event trigger (S3:ObjectPUT) is never firing. If I upload manually via the console, it all works. If I run the UNLOAD the data appears in the bucket, but the trigger event doesn't run.

I have tried creating / recreating the function (as per this forum thread - https://forums.aws.amazon.com/thread.jspa?messageID=768407&tstart=0), but to no avail.

Has anyone else had this - is there something I'm missing?

You did not tell how big data amounts you tested with, but if you test ok with little data block successfully and larger real situation fails, there may occur same as occurred here:


The larger files are almost certainly being uploaded via S3 Multipart Upload instead of a regular Put operation.


..


It sounds like the function is only subscribed to s3:ObjectCreated:Put events currently, and you need to add s3:ObjectCreated:CompleteMultipartUpload to the configuration.

StackExchange DevOps Q#2255, answer score: 1