Amazon Kinesis to Amazon Kinesis with filtering using Amazon EventBridge Pipes

Kinesis → Filter records → Filter records → EventBridge Pipes → EventBridge Pipes → Kinesis → Kinesis

This pattern will connect Kinesis data streams together with EventBridge Pipes. The source stream is filtered into multiple Kinesis streams downstream.

Kinesis stream is configured as the pipe source, and filters are created to filter records to downstream kinesis streams. This pattern allows you to filter kinesis streams into other kinesis streams.
How the pattern works
EventBridge Pipes is used to filter records from the source Kinesis stream into downstream consumers. Records are base64 encoded in Kinesis and EventBridge Pipes decodes the message and supports filtering on the payload of the message.

< Back to all patterns

GitHub icon Download this pattern (.zip)

GitHub icon View this pattern on GitHub


Clone repo

git clone https://github.com/aws-samples/serverless-patterns/cd serverless-patterns/eventbridge-pipes-kinesis-to-kinesis-with-filtering

Deploy

sam deploy --guided


Testing

See the README in the GitHub repo for detailed testing instructions.

Cleanup

Delete the stack: sam delete.

Created by:

David Boyne

David Boyne

Helping people learn about event-driven architectures and serverless

Follow on LinkedIn