Apache Airflow is a tool to express and execute workflows as directed acyclic graphs (DAGs). It includes utilities to schedule tasks, monitor task progress and handle task dependencies.
More on Apache Airflow
Launch on more than a container using Apache Airflow Cluster
Looking to use Apache Airflow with multiple concurrent jobs and heavier workloads? Use Bitnami’s Multi-Tier configuration, which uses the native cloud provider APIs to enable an Apache Airflow cluster with multiple virtual machines to distribute workloads over a configurable number of workers.
On Microsoft Azure, you can launch this configuration into your account using the Microsoft Azure Marketplace.
Why use the ?
- Consistent between platforms