Why tf.GradientTape() has less GPU memory usage when watch model variables manually?

Question

So when I use tf.GradientTape() to automatically monitor the trainable variables in a resnet model, the computer threw an out of memory error. Below is the code: