Best practices with Airflow- an open source platform for workflows & schedules

Опубликовано: 23 Ноябрь 2015
на канале: Treasure Data
26,933
206

Maxime Beauchemin with AirBnB speaks on how to use airflow to author workflows as directed acyclic graphs (DAGs) of tasks. The airflow scheduler executes your tasks on an array of workers while following the specified dependencies. Rich command line utilities make performing complex surgeries on DAGs a snap. The rich user interface makes it easy to visualize pipelines running in production, monitor progress, and troubleshoot issues when needed.