Tensorflow just released windows support. I installed the gpu version and CUDA 8.0 and python 3.5. However, after I import the tensorflow I got the following error:
You can also put the cuda64_5.dll in the C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v9.0\bin directory and it works fine.
You can use the folder GUI and load the .dll into the directory. Then you dont need to define the PATH every time you use Tensorflow.