Automate EMR Creation & Termination for Spark | Ready to use setup
This course provides an Airflow workflow, which does all the precomputes and native code executions on itself and then, only when it needs the Spark Job to be executed, it can request to spin up an EMR cluster, automatically submit your Spark job there, processes your data, and once the work is done, it takes care of automatically terminating that as well..!
Get the code at:
https://courses.gkcodelabs.com/produc...
