I built the gpu version of the docker image https://github.com/floydhub/dl-docker with keras version 2.0.0 and tensorflow version 0.12.1. I then ran the mnist tutorial https
In the future, you can try using virtual environments to separate tensorflow CPU and GPU, for example:
conda create --name tensorflow python=3.5 activate tensorflow pip install tensorflow
AND
conda create --name tensorflow-gpu python=3.5 activate tensorflow-gpu pip install tensorflow-gpu