Group By, Rank and aggregate spark data frame using pyspark

Question

I have a dataframe that looks like:

A     B    C
---------------
A1    B1   0.8
A1    B2   0.55
A1    B3   0.43

A2    B1   0.7
A2    B2   0.5
A2    B3   0.5         


        

Answer 1

windowSpec = Window.partitionBy("col1").orderBy("col2")

ranked = demand.withColumn("col_rank", row_number().over(windowSpec))

ranked.show(1000)

[![example][1]][1]