Spark Scala apply function on array of arrays element-wise

Question

Disclaimer: I\'m VERY new to spark and scala. I am working on a document similarity project in Scala with Spark. I have a dataframe which looks like this:

+--