DBT Workshop - Data Transformations using DBT and Spark on AWS EMR

Опубликовано: 04 Октябрь 2024
на канале: itversity

7,224

106

As part of this live workshop we will walk you through the demo using one of the most happening technologies in Data Lake and Data Engineering space which is nothing but DBT.

Don't forget to subscribe to our channel by clicking on http://youtube.com/itversityin?sub_co...

Material: / dbt-models-using-spark-on-emr

Here is the outline of the workshop:
0:00:00 -- Introduction
0:04:30 -- Overview of Data Engineering Courses published by ITVersity on Udemy
0:06:28 -- Special Note and Demo to Udemy Students - Rate and Review
0:07:16 -- Overview of DBT CLI and DBT Cloud
0:30:53 -- Setting up EMR Cluster with Thrift Server using Bootstrapping
0:41:33 -- Overview of Semi Structured Data Set used for the Demo
0:49:21 -- Develop required queries using Spark SQL on AWS EMR
1:12:29 -- Develop the Spark Application on AWS EMR using DBT Cloud
1:28:55 -- Run the Spark Application on AWS EMR using DBT Cloud
1:39:44 -- Overview of Orchestration using Tools like Airflow
Overview of our upcoming courses on Udemy

👨🏽‍💻𝗗𝗮𝘁𝗮 𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿𝗶𝗻𝗴 𝗘𝘀𝘀𝗲𝗻𝘁𝗶𝗮𝗹𝘀 𝗖𝗼𝘂𝗿𝘀𝗲𝘀 (𝘃𝗮𝗹𝗶𝗱 𝗳𝗼𝗿 𝘁𝗵𝗲 𝗻𝗲𝘅𝘁 𝟰 𝗱𝗮𝘆𝘀)👇🏻

📌Data Engineering Essentials Hands-on - SQL, Python, and Spark - $9.99 (includes 2 Weeks + 6 Weeks Lab Access) (🚨BESTSELLER)
🔗https://zcu.io/sF9o

📌Data Engineering using Kafka and Spark Structured Streaming - $9.99 (includes 2 Weeks + 6 Weeks Lab Access)
🔗https://zcu.io/gjSP

📌Spark SQL and PySpark 3 using Python 3 - $10.99 (includes 2 Weeks + 6 Weeks Lab Access) (🚨BESTSELLER)
🔗https://zcu.io/bYIG

📌Spark SQL and Spark using Scala - $10.99 (includes 2 Weeks + 6 Weeks Lab Access)
🔗https://zcu.io/XeWq

📌Linux Fundamental for IT Professionals - $9.99 (🔥NEW)
🔗https://zcu.io/JC0s

📌Practical Guide to setup Hadoop and Spark Cluster using CDH - $9.99
🔗https://zcu.io/DocO

📌Setup Big Data Development Environment for Spark and Hadoop - $9.99
🔗https://zcu.io/ukl4

👩🏻‍💻𝗗𝗮𝘁𝗮 𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿𝗶𝗻𝗴 𝘂𝘀𝗶𝗻𝗴 𝗔𝗪𝗦 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 𝗖𝗼𝘂𝗿𝘀𝗲𝘀 (𝘃𝗮𝗹𝗶𝗱 𝗳𝗼𝗿 𝘁𝗵𝗲 𝗻𝗲𝘅𝘁 𝟰 𝗱𝗮𝘆𝘀)👇🏻

📌Data Engineering Master Class using AWS Analytics (Glue, Kinesis, Lambda, Boto3, Redshift, Boto3, and more) - $9.99 (🚨BESTSELLER)
🔗https://zcu.io/Fu9H

📌Mastering AWS Lambda Functions for Data Engineers - $9.99(🔥NEW)
🔗https://zcu.io/oLXb

📌Mastering AWS Elastic Map Reduce for Data Engineers - $9.99(🔥NEW)
🔗https://zcu.io/lv4D

📌Mastering Amazon Redshift (including Server-less) for Data Engineers - $9.99 (🔥NEW)
🔗https://zcu.io/hV0q

👉🏼Stay tuned for our other in-depth courses on Data Engineering using AWS Analytics.

🧑🏻‍💻𝗗𝗮𝘁𝗮 𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿𝗶𝗻𝗴 𝘂𝘀𝗶𝗻𝗴 𝗗𝗮𝘁𝗮𝗯𝗿𝗶𝗰𝗸𝘀 𝗖𝗼𝘂𝗿𝘀𝗲𝘀 (𝘃𝗮𝗹𝗶𝗱 𝗳𝗼𝗿 𝘁𝗵𝗲 𝗻𝗲𝘅𝘁 𝟰 𝗱𝗮𝘆𝘀)👇🏻

📌Databricks Certified Associate Developer for Apache Spark using Apache Spark 3. - $9.99
🔗https://zcu.io/jIiv

📌Data Engineering using Databricks features on AWS and Azure - $9.99 (⚡️HIGHEST RATED)
🔗https://zcu.io/0KFb

📌Databricks Essentials for Spark Developers - $9.99 (Azure & AWS)
🔗https://zcu.io/tPFM
Join this channel to get access to perks:
/ @itversity