Is CUDA installation necessary to use GPU in Deep Learning execution

Question

The below question may sound naive but I really got the curiosity to know about it.

I have been listening that the TensorFlow library picks the GPU