Been trying to get used to the new structured streaming but it keeps giving me below error as soon as I start a .writeStream query.
Any idea what could
In my case I was using Windows 10 and had to change the Environment Variables-> User Variables
TMP and TEMP to Custom Location in some other volume (D:\Temp or E:\Temp etc..) instead of default
%USERPROFILE%\AppData\Local\Temp
and also set the HADOOP_HOME
System.setProperty( "hadoop.home.dir" , "$HADOOP_HOME\winutils-master\hadoop-2.x.x" )
Don't forget to copy the hadoop.dll to C:\Windows\System32.
You can download the appropriate version from this link. DOWNLOAD WINUTILS.exe
For me hadoop-2.7.1 version fixed the issue.