Spark Dataframe Cleansing | Learn Big Data On Windows 10 | Big Data Tutorial | Learn Big Data Online
Spark Dataframe Cleansing
#bigdata #spark #apachespark #sparkdataframe #sparkdataframeapi #dataanalytics #dataengineering
In this video you could learn the below items:
Spark Dataframe Cleansing Operations:
To drop duplicate rows from a dataframe.
To drop a specified column or columns from a dataframe.
To omit rows with null values.
To get all column data types.
To replace Null Values.
To filter rows with given conditions.
To replace one column value with another value.
To sort dataframe by specified column or columns.
To add a new column to the dataframe using the existing one.
To rename an existing column in the dataframe.
References:
https://spark.apache.org/docs/latest/...
