java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries. spark Eclipse on windows 7

Question

I\'m not able to run a simple spark job in Scala IDE (Maven spark project) installed on Windows 7

Spark core dependency has be

Answer 1

Follow this:

1. Create a bin folder in any directory(to be used in step 3).

2. Download winutils.exe and place it in the bin directory.

3. Now add System.setProperty("hadoop.home.dir", "PATH/TO/THE/DIR"); in your code.