Split Contents of String column in PySpark Dataframe

Question

I have a pyspark data frame whih has a column containing strings. I want to split this column into words

Code:

>>> sentenceData = sqlContext         


        

Answer 1

Use split function:

from pyspark.sql.functions import split

df.withColumn("desc", split("desc", "\s+"))