Low GPU usage while CPU is loaded running Deep learning models

Question

I have NVIDIA GeForce GTX 1050. with CUDA 11.1 and cuDNN 8.0.4. GPU usage is only below 14%. The CPU is getting loaded instead. How can I increase the usage of GPU? Is there