Using a GPU with Tensorflow and Cuda with NO admin rights - libcudart.so.11.0: cannot open shared object file

Question

I am trying to run tensorflow on a GPU at my university. I have to ssh into a remote machine and then ssh into my personal VM where I can access the GPU. I do NOT have admin rig