Tensorflow distributed training with custom training step

Question

I am facing slow training runs and I have tried to scale up the training procedure by using Tensorflow\'s Strategy API to utilize all 4 GPUs.

I\'m using