AWS Step Functions to AWS Glue

Step Functions → AWS Glue → Amazon S3

Create an AWS Step Functions workflow to integrate with AWS Glue.

This patters deploys a Step Functions that includes a Glue Job as one of its steps. The Glue Job may be used to process data from S3 or other AWS storage services.

< Back to all patterns

GitHub icon Download this pattern (.zip)

GitHub icon View this pattern on GitHub


Clone repo

git clone https://github.com/aws-samples/serverless-patterns/cd serverless-patterns/sfn-glue-sam

Deploy

sam build --template code/cloudformation/stack.yamlsam deploy --guided


Testing

See the GitHub repo for detailed testing instructions.

Cleanup

1. Delete the stack: sam delete --stack-name STACK_NAME.
2. Confirm the stack has been deleted: aws cloudformation list-stacks --query "StackSummaries[?contains(StackName,'STACK_NAME')].StackStatus"

Created by:

Nicoli Araujo

Nicoli Araujo

Associate Data Scientist at AWS.