Tech Island

Trigger SQL File from Snowflake CLI Client

6. Compare 2 DataFrame using STACK and eqNullSafe to get corrupt records | Apache Spark🌟Tips 💡

1. Clean way to rename columns in Spark Dataframe | one line code | Spark🌟 Tips 💡

3. Preserve RDBMS table's metadata when overwriting table from Spark using TRUNCATE | Spark🌟Tips 💡

4. Read CSV file efficiently- Sampling Ratio, scans less data | Schema to avoid file scan|Spark Tips

Spark 3.0 Features | Dynamic Partition Pruning (DPP) | Avoid Scanning Irrelevant Data

5. eqNullSafe | Equality test that is safe for null values | Apache Spark🌟Tips 💡

Trigger SQL File from Snowflake CLI Client

spark snowflake connector with sample spark/scala code

Spark Structured Streaming as a Batch Job? File based data ingestion benefits from pseudo streaming?

What is and why Delta Lake - Part 1

Pushing Spark query processing to Snowflake using Spark-Snowflake connector