Convert to upper case, lower case and title case in pyspark

In order to convert a column to Upper case in pyspark we will be using upper() function, to convert a column to Lower case in pyspark is done using lower() function, and in order to convert to  title case or proper case  in pyspark uses initcap() function. Let’s see an example of each.

• Convert column to upper case in pyspark – upper() function
• Convert column to lower case in pyspark – lower() function
• Convert column to title case or proper case in pyspark – initcap() function

We will be using dataframe df_states

Convert column to upper case in pyspark  – upper() Function :

Syntax:

colname1 – Column name

upper() Function takes up the column name as argument and converts the column to upper case.

########## convert column to upper case in pyspark

from pyspark.sql.functions import upper, col
df_states.select("*", upper(col('state_name'))).show()

column “state_name” is converted to upper case as shown below

Convert column to Lower case in pyspark – lower() function :

Syntax:

colname1 – Column name

lower() Function takes up the column name as argument and converts the column to lower case

########## convert column to lower case in pyspark

from pyspark.sql.functions import lower, col
df_states.select("*", lower(col('state_name'))).show()

column “state_name” is converted to lower case as shown below

Convert column to Title or proper case in pyspark  – initcap() function:

Syntax:

colname1 – Column name

initcap() Function takes up the column name as argument and converts the column to title case or proper case

########## convert column to title case

from pyspark.sql.functions import initcap, col
df_states.select("*", initcap(col('state_name'))).show()

column “state_name” is converted to title case or proper case as shown below,

Other Related Topics:

• Remove leading zero of column in pyspark
• Left and Right pad of column in pyspark –lpad() & rpad()
• Add Leading and Trailing space of column in pyspark – add space
• Remove Leading, Trailing and all space of column in pyspark – strip & trim space
• String split of the columns in pyspark
• Repeat the column in Pyspark
• Get Substring of the column in Pyspark
• Get String length of column in Pyspark
• Typecast string to date and date to string in Pyspark
• Typecast Integer to string and String to integer in Pyspark
• Convert to upper case, lower case and title case in pyspark
• Extract First N and Last N character in pyspark
• Add leading zeros to the column in pyspark
• Concatenate two columns in pyspark