Save ML model for future usage

Question

I was applying some Machine Learning algorithms like Linear Regression, Logistic Regression, and Naive Bayes to some data, but I was trying to avoid using RDDs and start usi

Answer 1

It seems as if the API functionality to save a model is not implemented as of today (see Spark issue tracker SPARK-6725).

An alternative was posted (How to save models from ML Pipeline to S3 or HDFS?) which involves simply serializing the model, but is a Java approach. I expect that in PySpark you could do something similar, i.e. pickle the model to write to disk.