Chase The Sun: Build greener DAGs with VertFlow

Опубликовано: 15 Октябрь 2024
на канале: Apache Airflow
302
3

Presented by Jack Lockyer-Stevens at Airflow Summit 2023.

In 2022, cloud data centres accounted for up to 3.7% of global greenhouse gas emissions, exceeding those of aviation and shipping. Yet in the same year, Britain wasted 4 Terawatt hours of renewable energy because it couldn’t be transported from where it was generated to where it was needed. So why not move the cloud to the clean energy? VertFlow is an Airflow operator that deploys workloads to the greenest Google Cloud data centre, based on the realtime carbon intensity of electricity grids worldwide.