4. Read CSV file efficiently- Sampling Ratio, scans less data | Schema to avoid file scan|Spark Tips

Опубликовано: 13 Октябрь 2024
на канале: Tech Island
729
21

4. Read CSV file efficiently i)using sampling ratio to scan less data & ii)schema option to avoid scanning data | Spark 🌟 Tips 💡


How to read csv file efficiently
i) using sampling ratio to scan less data
ii) schema option to avoid scanning data


Also, we will see schema_of_csv option, which is spark 3.0 feature.


Please SUBSCRIBE to our channel :)
Help us reaching 1000 subscribers...




Facebook Page - https://www.facebook.com/Tech-Island-...


Content By:
Karthikeyan Siva Baskaran [LinkedIn -   / karthikeyan-siva-baskaran-7a9551ab  ]


Editing By - Sivaraman Ravi [LinkedIn -   / sivaraman.  .]


Please SUBSCRIBE to our channel :)


Share your feedback with us.
[email protected]