Data Processing Pattern

Processes images from S3 and extracts metadata and labels, storing them in DynamoDB

This application creates a DynamoDB table, S3 bucket and State Machine. The State Machine processes a list of images and retrieves objects metadata and image labels using machine learning in parallel, ultimately storing the result as one entry in the DynamoDB table. This pattern demonstrates how Step Functions can work with multiple data stores, manipulate, merge and store data for later prcessing.

< Back to all workflows

GitHub icon View this workflow on GitHub


Clone repo

git clone https://github.com/aws-samples/step-functions-workflows-collection/tree/main/data-processing-tf/cd step-functions-workflows-collection/data-processing-tf/

Deploy

terraform initterraform apply


Testing

See the GitHub repo for detailed testing instructions.

Cleanup

1. Delete the stack: terraform destroy.

Created by:

Ahmad Aboushady

Ahmad Aboushady

Senior Technical Account Manager, AWS