PySpark for absolute beginners - part 1
This video series will help you learn PySpark from a very beginner level.
In this video I have explained key concepts to start with:
1) Compute
2) Storage
3) Parallelism
4) Distribution
5) Dataframe
6) Parquet
We will also signup for databricks community edition & setup environment to run pyspark application.
Databricks community link : https://community.cloud.databricks.com
video timeline:
00:00 Introduction - PySpark for beginners
00:17 First two concepts - Compute and Storage
03:18 Two more concepts - Parallelism & distribution
05:42 Databrick community edition - Signup
11:05 Two more concepts - Dataframe & Parquet
![SQL Timestamp ETL timezone problems are a NIGHTMARE [ETL Scenario -4] #sql #etl](https://images.videosashka.com/watch/7OQGTmU-SHs)
![Aggregate Fact Tables in Data Warehouse - Concept you must know [ETL Scenario -5] #etl #sql #dwh](https://images.videosashka.com/watch/Sy4_pkUqGmE)
![ETL Script Types and Concepts: The Ultimate Guide [ETL Scenario -3] #etl #sql](https://images.videosashka.com/watch/Xol-A26o6MQ)
![Intra-day Job orchestration & SQL: A full tutorial with example [ETL Scenario -2] #etl](https://images.videosashka.com/watch/kbQceQLRRZI)
![Do NOT run DROP TABLE in PRODUCTION. Use 2 alternate solutions [ETL Scenario -1 ] #etl #sql](https://images.videosashka.com/watch/FrlhAScErV8)
![The Frightening Reality Of Missing Records In An ETL Scenario [ETL Scenario -6] #sql #etl](https://images.videosashka.com/watch/w6SRJI0KZ6Q)
