how to solve this use-case, any way to use , array, struct , explode and structure data?
问题 I am using spark-sql-2.4.1v with Java 8. I need to calculate percentiles such as 25,75,90 for some given data. Given source dataset: val df = Seq( (10, "1/15/2018", 0.010680705, 10, 0.619875458, 0.010680705, "east"), (10, "1/15/2018", 0.006628853, 4, 0.16039063, 0.01378215, "west"), (10, "1/15/2018", 0.01378215, 20, 0.082049528, 0.010680705, "east"), (10, "1/15/2018", 0.810680705, 6, 0.819875458, 0.702228853, "west"), (10, "1/15/2018", 0.702228853, 30, 0.916039063, 0.810680705, "east"), (11,