TensorFlow in nvidia-docker: failed call to cuInit: CUDA_ERROR_UNKNOWN

Question

I have been working on getting an application that relies on TensorFlow to work as a docker container with nvidia-docker. I have compiled my application on top

Answer 1

Maybe the problem is related to JIT caching files permissions, created by GPU. On linux, by default, cache files were created at ~/.nv/ComputeCache. Setting another directory for JIT cache solves the problem. Just do

export CUDA_CACHE_PATH=/tmp/nvidia

before running something on GPU.