TF 2.3 using experimental_steps_per_execution in model.compile cause drop in model performance

Question

Using TPU, I have tried to pass experimental_steps_per_execution to model.compile(...), I do see a big speedup, but for the exact learning rate schedule, I noticed a 2-3% dr