Managed Service for Apache Flink writing stream data to Amazon S3

Kinesis Data Streams → Managed Service for Apache Flink → Amazon S3

Transform incoming stream data and deliver the transformed data to S3 destination as a Sink

This pattern creates an Apache Flink application that has a Kinesis Data Stream as a source and an Amazon S3 bucket as a sink.
Managed Service for Apache Flink handles core capabilities like provisioning compute resources, parallel computation, automatic scaling, and application backups (implemented as checkpoints and snapshots).

< Back to all patterns

GitHub icon Download this pattern (.zip)

GitHub icon View this pattern on GitHub


Clone repo

git clone https://github.com/aws-samples/serverless-patterns/cd serverless-patterns/kinesis-dataanalytics-flink-s3-sink

Deploy

terraform initterraform planterraform apply


Testing

See the README in the GitHub repo for detailed testing instructions.

Cleanup

terraform destroy
terraform show

Created by:

Naresh Rajaram

Naresh Rajaram

Cloud Infrastructure Architect, AWS

Follow on LinkedIn