Webinar: Get Hands-On With ServerlessRegister now

AWS Lambda to AWS Glue to Amazon S3

AWS Lambda → Glue → S3

Create an AWS Lambda function to invoke a AWS Glue job to run the task and save the output file in Amazon S3

This CDK application deploys a Lambda function, that takes in a payload and triggers a AWS Glue job synchronously.
The Glue job then performs the assigned task to convert a CSV file to Parquet and uploads the output file to S3. The application contains the minimum IAM permissions required to run the workflow and Glue job.
This pattern deploys one Lambda Function, one S3 Bucket and one Glue ETL Job.

< Back to all patterns
Language:
Python
Framework:
AWS CDK

GitHub icon Download this pattern (.zip)

GitHub icon View this pattern on GitHub

Clone repo

git clone https://github.com/aws-samples/serverless-patterns/cd serverless-patterns/lambda-glue-s3

Deploy

cdk deploy

Testing

See the GitHub repo for detailed testing instructions.

Cleanup

Delete the stack: cdk delete.

Additional resources

Created by:

Harshitha Shashidhar

Harshitha Shashidhar is an Cloud Application architect who loves to build the serverless applications at scale.

Shruti Arora

Shruti Arora

Shruti is a Cloud Application Architect with AWS Professional Services Team. Passionate about serverless development.