8 тысяч подписчиков
413 видео
Address Routing Explained in 60 Seconds!
Databricks Vs. Airflow for ETL Workflows!
How to Do Data Integrity Checks with Airflow!
How to Turn Python Functions into Airflow Tasks!
What is Data Modelling? Beginner's Guide to Data Models and Data Modelling
How to Submit a PySpark Script to a Spark Cluster Using Airflow!
How to Add Slack Notifications to Your Airflow DAG's with Airflow Notifiers!
How to Produce and Consume Messages to/from a Kafka Cluster Using Airflow!
How to Run SQL Queries on Excel Spreadsheets Using Airflow!
How to Migrate Data from a Postgres SQL Database to a Snowflake Database Using Apache Airflow!
How to Build a Retrieval Augmented Generation Pipeline with Meta's LLAMA 3 Large Language Model!
How to Build an ETL Pipeline from Spark to a Cassandra Database using Airflow!
How to Create an End-to-End ETL Analytics Pipeline with Airflow and Databricks
How to Migrate Data from MSSQL Server to Snowflake using Airflow!
How to Migrate Data from MongoDB to a MySql Database with Airflow!
How to Schedule and Execute SQL Commands on a Redshift Database using Airflow!
Apache Hudi Vs Apache Iceberg! Apache Hudi and Iceberg Comparison!
The Airflow AI: Ask Astro
Python Basics For Data Engineers! Python Data Engineering Basics!
Top Python Utility Scripts for Data Engineers and Data Scientists!
How to Schedule and Run Azure Synapse Spark Jobs Using Airflow!
How to Build an ETL Pipeline with Postgres, Azure Data Factory, and Airflow!
Intro to Node.js and Node Package Manager(NPM)! Backend Development for Beginners!
How to Use DuckDB, MotherDuck and Airflow Together!
What Does a Data Engineer Do?
End-to-End Data Pipeline Project with Change Data Capture Using Postgres, Airflow, and Snowflake!
How to Set Up CICD Pipelines Using Github Actions for Airflow!
How to Manage Azure Data Factory Pipelines Using Airflow!
How to Migrate Data from a Redshift Database to Any SQL Database Using Airflow!
How to Create an ELT Pipeline Using Airflow, Snowflake, and dbt!
Introduction to Apache Hudi for Data Lake Management! Apache Hudi for Beginners!
How to Monitor a Kafka Topic Using Airflow!
How to Use the Python Virtual Environment Operator in Airflow!
How to Run a Spark Cluster with Multiple Workers Locally Using Docker
How Airbnb Manages Machine Learning at Scale with Chronon! Airbnb's Chronon Platform Explained!
How to Create a Data Streaming Pipeline with Databricks Spark, Apache Kafka, and Airflow!
What is Change Data Capture and How Do You Do it? Beginner's Guide to Change Data Capture
How to Create a Streamlit Reporting Dashboard Using Snowflake Data!
What Are Data Quality Checks and Why Are They Important? Definitive Guide to Data Quality Checks
How to Batch Run Machine Learning Models with Apache Flink's PyFlink!
End-to-End Parallel ETL Pipeline with Airflow, Snowflake, and S3 Buckets!
How to Run Airflow Locally without Docker Desktop using Podman!
How to Create Data Quality Checks in Snowflake Using Airflow!
Apache Flink Vs. Apache Spark Vs. Apache Storm: Which Data Processing Tool is Right for You!
How to Make Multiple API Requests at Once Using Airflow!
How to Use Great Expectations for Data Quality Checks with Airflow
Extract, Load, Transform (ELT) Pipelines Explained in Under 60 Seconds
How to Run AWS Glue Jobs with Airflow! Use Airflow to Manage Amazon Glue Jobs
Database vs. Data Warehouse vs. Data Lake: Ultimate Guide to Data Storage Solutions
How to Perform Sentiment Analysis with Apache Spark and Weaviate Vector Database!
What is a Data Pipeline?