4. Read CSV file efficiently i)using sampling ratio to scan less data & ii)schema option to avoid scanning data | Spark 🌟 Tips 💡
How to read csv file efficiently
i) using sampling ratio to scan less data
ii) schema option to avoid scanning data
Also, we will see schema_of_csv option, which is spark 3.0 feature.
Please SUBSCRIBE to our channel :)
Help us reaching 1000 subscribers...
Facebook Page - https://www.facebook.com/Tech-Island-...
Content By:
Karthikeyan Siva Baskaran [LinkedIn - / karthikeyan-siva-baskaran-7a9551ab ]
Editing By - Sivaraman Ravi [LinkedIn - / sivaraman. .]
Please SUBSCRIBE to our channel :)
Share your feedback with us.
[email protected]