I am working in PySpark on a Jupyter notebook (Python 2.7) in windows 7. I have an RDD of type pyspark.rdd.PipelinedRDD called idSums. When attempt
pyspark.rdd.PipelinedRDD
idSums
I had a similar exception saying permission issue when loading a model built in some other machine and copied in my Windows system although my HADOOP_HOME was set.
HADOOP_HOME
I just ran the following command over my model folder:
winutils.exe chmod -R 777 model-path