Best way to get the max value in a Spark dataframe column

Question

I\'m trying to figure out the best way to get the largest value in a Spark dataframe column.

Consider the following example:

df = spark.createDataFra         


        

Answer 1

in pyspark you can do this:

max(df.select('ColumnName').rdd.flatMap(lambda x: x).collect())