Distributed Map CSV iterator with Terraform

This workflow is an example application of a step function using distributed map. This distributed map iterates over an CSV file that is stored in an S3 bucket.

The state machine will take as an input a CSV file that contains a header and multiple items. For each item, the Map state runs each iteration as a child workflow execution, which enables high concurrency of up to 10,000 parallel child workflow executions.
Each of the Map state will add the item to a DynamoDB table. But you can do more complex things in this state machine.

< Back to all workflows

GitHub icon View this workflow on GitHub


Clone repo

git clone https://github.com/aws-samples/step-functions-workflows-collection/tree/main/distributed-map-csv-iterator-tf/cd step-functions-workflows-collection/distributed-map-csv-iterator-tf

Deploy

terraform initterraform apply


Testing

See the GitHub repo for detailed testing instructions.

Cleanup

1. Delete the stack: terraform destroy.

Additional resources

Created by:

Ahmad Aboushady

Ahmad Aboushady

Senior Technical Account Manager, AWS