Data Engineer's Lunch 106: Designing an analytics pipeline with BigQuery and dbt: a walkthrough

Опубликовано: 07 Октябрь 2024
на канале: Anant Corp
356
17

This talk covers a walkthrough of a personal project to build a batch ELT pipeline to gather, transform, and prepare tennis match level data for analysis. Tools used include Python and Prefect for extraction and orchestration, BigQuery for data warehousing, and dbt for transformation.Transformed data is visualized in Looker Studio.


Accompanying SlideShare: Coming Soon!

Sign Up For Our Newsletter: http://eepurl.com/grdMkn

Join Data Engineer’s Lunch Weekly at 12 PM EST on Mondays:
https://www.meetup.com/Data-Wranglers...

Cassandra.Link:
https://cassandra.link/

Follow Us and Reach Us At:

Anant:
https://www.anant.us/

Awesome Cassandra:
https://github.com/Anant/awesome-cass...

Email:
[email protected]

LinkedIn:
  / anant  

Twitter:
  / anantcorp  

Eventbrite:
https://www.eventbrite.com/o/anant-10...

Facebook:
  / anantcorp  

Join The Anant Team:
https://www.careers.anant.us

#data #dataengineering #datalakehouse