PySpark – date_format()

pyspark-mytechmint

In PySpark use date_format() function to convert the DataFrame column from Date to String format. In this tutorial, we will show you a Spark SQL example of …

Read More ➜

PySpark – to_date()

pyspark-mytechmint

PySpark functions provide to_date() function to convert timestamp to date (DateType), this is ideally achieved by just truncating the time part from the Timestamp column. …

Read More ➜

PySpark – to_timestamp()

pyspark-mytechmint

Use to_timestamp() function to convert String to Timestamp (TimestampType) in PySpark. The converted time would be in a default format of MM-dd-yyyy HH:mm:ss.SSS, I will explain how …

Read More ➜

PySpark – concat_ws()

pyspark-mytechmint

In this PySpark article, We will learn how to convert an array of String column on DataFrame to a String column (separated or concatenated with …

Read More ➜