PySpark & MLLib: Class Probabilities of Random Forest Predictions

Question

I\'m trying to extract the class probabilities of a random forest object I have trained using PySpark. However, I do not see an example of it anywhere in the documentation, nor

Answer 1

This is now available.

Spark ML provides:

• a predictionCol that contains the predicted label
• and a probabilityCol that contains a vector with the probabilities for each label, this is what you where looking for!
• You can also access the raw counts

For more details, here is the Spark Documentation: http://spark.apache.org/docs/latest/ml-classification-regression.html#output-columns-predictions