We have a hive warehouse, and wanted to use spark for various tasks (mainly classification). At times write the results back as a hive table. For example, we wrote the following
This error can solved by setting hive.exec.scratchdir to the folder where user has access