API304: Amazon MWAA at Scale

Resources for API304: Amazon MWAA at scale

In this talk, Uma Ramadoss and John Jackson will share first-hand experience and practical steps for running highly performant workflows in Amazon MWAA. They will walk through internal workings of Apache Airflow and MWAA, share tips and best practices and show an example of running a workflow through a series of performance tuning techniques. You will come away with an understanding of how to author and run your workflows at scale in production.

Apache Airflow best practices

Tutorial

Learn the best practices of Apache Airflow

Apache Airflow scheduler

Tutorial

Learn internal details of Apache Airflow Scheduler

Improve worker performance

Sample

Try out the example in a Dynamic Dag to improve worker performance

Apache Airflow at scale

Video

Understand the considerations and challenges when running Apache Airflow at scale

Presented by:

John Jackson

John Jackson

I have over 20 years of software experience as a developer, systems architect, and product manager in both startups and large corporations and is the AWS Principal Product Manager responsible for Amazon MWAA

Uma Ramadoss

Uma Ramadoss

Solutions Architect @ AWS.