Amazon Kinesis Data Streams to Amazon OpenSearch via Amazon Data Firehose

Kinesis Data Stream → Amazon Data Firehose → Amazon OpenSearch Service

Send data received by Kinesis Data Streams to Amazon OpenSearch via Amazon Data Firehose.

This SAM template creates a Kinesis Data Stream, Amazon Data Firehose and Amazon OpenSearch Service serverless collection. Amazon Data Firehose is configured with Kinesis Data Stream as a source and Amazon OpenSearch as a destination.
When a message is pushed to the Kinesis Data Stream, it's replicated to OpenSearch using Amazon Data Firehose. If any messages can not be processed by Amazon Data Firehose, they are sent to an S3 bucket.

< Back to all patterns

GitHub icon View this pattern on GitHub


Clone repo

git clone https://github.com/aws-samples/serverless-patterns/cd serverless-patterns/kds-kdf-opensearch

Deploy

sam deploy --guided


Testing

See the GitHub repo for detailed testing instructions.

Cleanup

Delete the stack: sam delete.

Created by:

Biswanath Mukherjee

Biswanath Mukherjee

Sr. Solutions Architect working at AWS India.

Follow on LinkedIn