Keras getting frozen when using regularizer in CNN model

Question

I had a custom CNN implementation in keras running with TensorFlow backend. To improve generalizability I was working on adding regularization to the CNN model. The model wo