Serverless Data Enrichment Pipeline with Persistence

Amazon SNS → Amazon SQS → AWS Lambda → Amazon DynamoDB

This pattern helps you deploy a CDK stack with SNS, SQS, Lambda and DynamoDB.

The pattern uses these AWS services to create a serverless data enrichment pipeline with persistence of data in SQS. The Lambda functions are used to consume data from SQS queues, perform enrichment, and update DynamoDB tables. The enriched data is further sent to another SQS queue.
Data Pipeline Stack #1, relay the raw message from SNS to DynamoDB.
Data Pipeline Stack #2, relay the enrich message from SNS and route it to DynamoDB & SQS.

< Back to all patterns

GitHub icon Download this pattern (.zip)

GitHub icon View this pattern on GitHub


Clone repo

git clone https://github.com/aws-samples/serverless-patterns/cd serverless-patterns/cdk-sns-sqs-lambda-dynamodb-dotnet

Deploy

See the GitHub repo for detailed deployment instructions.


Testing

See the GitHub repo for detailed testing instructions.

Cleanup

See the GitHub repo for detailed deployment instructions.

Created by:

Sakthivel Chellapparimanam

AWS - Cloud Application Architect

Follow on LinkedIn