[{"data":1,"prerenderedAt":67},["ShallowReactive",2],{"pattern-s3-trigger-lambda-glue-workflow-terraform":3},{"id":4,"title":5,"architectureURL":6,"cleanup":7,"contributors":10,"deploy":12,"description":15,"extension":16,"framework":17,"gitHub":18,"highlight":6,"introBox":24,"language":29,"level":30,"meta":31,"patternArch":32,"resources":51,"s3URL":6,"services":6,"stem":62,"testing":63,"videoId":6,"__hash__":66},"patterns\u002Fpatterns\u002Fs3-trigger-lambda-glue-workflow-terraform.json","AWS S3 Trigger to AWS Lambda to AWS Glue workflow",null,{"text":8},[9],"terraform destroy",[11],"content\u002Fcontributors\u002Fananth-tirumanur.json",{"text":13},[14],"terraform init && terraform apply","S3 bucket trigger invokes a Lambda function on file upload, which starts a Glue workflow with file key and bucket parameters.","json","Terraform",{"template":19},{"repoURL":20,"templateURL":21,"projectFolder":22,"templateFile":23},"https:\u002F\u002Fgithub.com\u002Faws-samples\u002Fserverless-patterns\u002Ftree\u002Fmain\u002Fs3-trigger-lambda-glue-workflow-terraform","serverless-patterns\u002Fs3-trigger-lambda-glue-workflow-terraform","s3-trigger-lambda-glue-workflow-terraform","main.tf",{"headline":25,"text":26},"How it works",[27,28],"For cases where we need to process files using Glue jobs, we can use Glue Workflows to orchestrate our Glue jobs and Glue crawlers.","S3 trigger is set up to trigger the Lambda on file upload event. To be able to trigger a Glue workflow with certain parameters, we use AWS Lambda to start glue workflows with parameters.","Python","200",{},{"icon1":33,"icon2":38,"icon3":41,"line1":45,"line2":49},{"x":34,"y":35,"service":36,"label":37},20,50,"s3","S3",{"x":35,"y":35,"service":39,"label":40},"lambda","Lambda",{"x":42,"y":35,"service":43,"label":44},80,"glue","AWS Glue",{"from":46,"to":47,"label":48},"icon1","icon2","",{"from":47,"to":50,"label":48},"icon3",{"bullets":52},[53,56,59],{"test":54,"link":55},"AWS Lambda Developer Guide","https:\u002F\u002Fdocs.aws.amazon.com\u002Flambda\u002Flatest\u002Fdg\u002Fwelcome.html",{"text":57,"link":58},"AWS Glue - What is AWS Glue?","https:\u002F\u002Fdocs.aws.amazon.com\u002Fglue\u002Flatest\u002Fdg\u002Fwhat-is-glue.html",{"text":60,"link":61},"AWS boto3 library for Python- Glue","https:\u002F\u002Fboto3.amazonaws.com\u002Fv1\u002Fdocumentation\u002Fapi\u002Flatest\u002Freference\u002Fservices\u002Fglue.html","patterns\u002Fs3-trigger-lambda-glue-workflow-terraform",{"text":64},[65],"See the GitHub repo for detailed testing instructions.","3zmvCbosQSCSh27SVcayecMpvF-3tVWJDO1bu3cg7jI",1778927711036]