Webinar: Get Hands-On With ServerlessRegister now

Amazon Kinesis Data Streams to Amazon OpenSearch via Amazon Data Firehose

Kinesis Data Stream → Kinesis Data Firehose → Amazon OpenSearch Service

Send data received by Kinesis Data Streams to Amazon OpenSearch via Kinesis Data Firehose.

This SAM template creates a Kinesis Data Stream, Kinesis Data Firehose and Amazon OpenSearch Service serverless collection. Kinesis Data Firehose is configured with Kinesis Data Stream as a source and Amazon OpenSearch as a destination.
When a message is pushed to the Kinesis Data Stream, it's replicated to OpenSearch using Kinesis Data Firehose. If any messages can not be processed by Kinesis Data Firehose, they are sent to an S3 bucket.

< Back to all patterns
Language:
YAML
Framework:
AWS SAM

GitHub icon Download this pattern (.zip)

GitHub icon View this pattern on GitHub

Clone repo

git clone https://github.com/aws-samples/serverless-patterns/cd serverless-patterns/kds-kdf-opensearch

Deploy

sam deploy --guided

Testing

See the GitHub repo for detailed testing instructions.

Cleanup

Delete the stack: sam delete.

Additional resources

Created by:

Biswanath Mukherjee

Biswanath Mukherjee

Sr. Solutions Architect working at AWS India.

Follow on LinkedIn