Handling the Data Skewness using Key Salting Technique. One of the biggest problem in parallel computational systems is data skewness. Data Skewness in Spark happens due to joining on a key that is not evenly distributed across the cluster, causing some partitions to be very large and not allowing Spark to process data in parallel.
GitHub Link - https://github.com/gjeevanm/SparkData...
Content By - Jeevan Madhur [LinkedIn - / jeevan-madhur-225a3a86 ]
Editing By - Sivaraman Ravi [LinkedIn - / sivaraman-ravi-791838114 ]