Customers run containerized workloads in Amazon ECS, Amazon EKS or their own containerized environments outside AWS. To accomplish business operations, effective co-ordination of these workloads is essential. For instance, generating a ready-to-consume golden dataset often requires the execution of multiple Spark jobs, either in parallel or sequentially. Without orchestration, managing and automating these jobs can be difficult and time-consuming because it requires coordinating the execution of multiple tasks and ensuring that they are executed in the correct order.

AWS Step Functions is a serverless visual workflow service that enables you to connect multiples tasks together to build and run your business workflows at scale with minimal code.

In this guide, you learn different ways you can integrate your workload running in Amazon EKS/Amazon ECS and on-premise with AWS Step Functions, pros and cons of each integration, and when to choose a particular type of integration.