I\'m trying to install CUDA 7.5 in my ubuntu 14.04. I followed everything in this guide (installation through package): http://developer.download.nvidia.com/compute/cuda/7.5/Pro
I tracked the CUDA installation folder to /usr/lib/nvidia-cuda-toolkit. How? I used locate nvcc.
I had installed NVIDIA driver using the Software and Updates --> Additional Drivers followed by CUDA Toolkit installation using sudo apt install nvidia-cuda-toolkit on Ubuntu 20.04. nvcc --version was working fine but when it came to verifying cuDNN installation (https://docs.nvidia.com/deeplearning/cudnn/install-guide/index.html#verify), it was looking for the usr/local/cuda folder and failed.
I, therefore, created a symlink usr/local/cuda to /usr/lib/nvidia-cuda-toolkit as so: ln -s /usr/lib/nvidia-cuda-toolkit/ /usr/local/cuda.
Also added /usr/lib/nvidia-cuda-toolkit/libdevice to $LD_LIBRARY_PATH and /usr/lib/nvidia-cuda-toolkit/bin to$PATH variables.
All is working fine now.