How to run airflow locally without docker

Опубликовано: 10 Март 2025
на канале: pyGPT

147

Get Free GPT4o from https://codegive.com
running apache airflow locally without using docker involves setting up the necessary dependencies and configurations on your machine. here is a step-by-step tutorial on how to achieve this:

step 1: install python and pip
make sure you have python installed on your machine. you can download and install python from the official website. pip should be installed automatically with python.

step 2: install apache airflow
you can install apache airflow using pip. run the following command to install apache airflow:

step 3: initialize the airflow database
after installing apache airflow, you need to initialize the database. run the following commands:

step 4: start the airflow web server and scheduler
you can start the airflow web server and scheduler by running the following commands:

step 5: access the airflow ui
once the web server is running, you can access the airflow ui by opening a web browser and navigating to `http://localhost:8080`.

step 6: create your dags
you can create your directed acyclic graphs (dags) in the `dags` folder located in the airflow home directory. you can define your workflows using python scripts in this folder.

step 7: test your dags
after creating your dags, you can test them by triggering them manually or scheduling them to run at specific intervals.

by following these steps, you can run apache airflow locally without using docker. this setup allows you to develop and test your workflows on your local machine.

example code:
here is an example of a simple dag that prints "hello, airflow!" using the pythonoperator:

save the above code in a python script inside the `dags` folder of your airflow home directory. this dag will run a task that prints "hello, airflow!" when triggered.

...

#python airflow dag example
#python airflow
#python airflow baseoperator
#python airflow shortcircuitoperator
#python airflow dag

python airflow dag example
python airflow
python airflow baseoperator
python airflow shortcircuitoperator
python airflow dag
python airflow operator
python airflow package
python airflow tutorial
python airflow example
python airflow client
python docker library
python docker image
python docker package
python docker hub
python docker tutorial
python dockerfile example
python docker compose
python docker