Amazon S3 to Amazon EventBridge to ECS

S3 → Amazon EventBridge → Elastic Container Service

Create an integration between S3, EventBridge and ECS.

This serverless pattern uses EventBridge to trigger multiple ECS tasks on Fargate. The ECS task queries the S3 bucket for files and reads them.
These ECS tasks can be extended to insert the data to a database, thus speeding up the process of loading data from S3 to a database. This application pattern can be extended to process a file from a single bucket in parallel or perform long running tasks not suited for Lambda processing in parallel.

< Back to all patterns

GitHub icon Download this pattern (.zip)

GitHub icon View this pattern on GitHub


Clone repo

git clone https://github.com/aws-samples/serverless-patterns/cd serverless-patterns/s3-eventbridge-ecs

Deploy

See the GitHub repo for detailed deployment and testing instructions.


Testing

See the GitHub repo for detailed testing instructions.

Cleanup

Delete the stack: terraform destroy.

Created by:

Jeff Hunter

Jeff Hunter

AWS Sr. Solutions Architect

Rajdeep Banerjee

AWS Sr. Solutions Architect