S3 bucket trigger invokes a Lambda function on file upload, which starts a Glue workflow with file key and bucket parameters.
For cases where we need to process files using Glue jobs, we can use Glue Workflows to orchestrate our Glue jobs and Glue crawlers.
S3 trigger is set up to trigger the Lambda on file upload event. To be able to trigger a Glue workflow with certain parameters, we use AWS Lambda to start glue workflows with parameters.
< Back to all patterns
Clone repo
git clone https://github.com/aws-samples/serverless-patterns/cd serverless-patterns/s3-trigger-lambda-glue-workflow-terraformDeploy
terraform init && terraform applyTesting
See the GitHub repo for detailed testing instructions.
Cleanup
terraform destroy
Created by:
