Create an AWS Step Functions workflow to integrate with AWS Glue.
The Terraform template deploys a AWS Step Function, a AWS Glue Job, a CloudWatch Event Rule, a Amazon S3 bucket and the minimum IAM resources required to run the application.
This pattern demonstrates the use of Terraform modules and deploys the below resources:
- Amazon S3 bucket and load the sample Python script as an object
- Sample AWS Glue Job which executes the script in the S3 bucket
- AWS Step Functionsto invoke the AWS Glue Job synchronously. The Function will wait until the Job is completed
- CloudWatch Event Rule which is configured to start the AWS Step Functionsevey 10 minutes
< Back to all patterns
Clone repo
git clone https://github.com/aws-samples/serverless-patterns/cd serverless-patterns/sfn-glue-terraformDeploy
terraform initterraform applyTesting
See the GitHub repo for detailed testing instructions.
Cleanup
1. Delete the stack:
terraform apply -destroy.2. Confirm the stack has been deleted:
aws cloudformation list-stacks --query "StackSummaries[?contains(StackName,'STACK_NAME')].StackStatus"