Pytorch Loss function not decresing

Question

I am implementing the counterfactual fairness in Pyro as discussed in this paper(https://arxiv.org/abs/1703.06856). I have constructed a Structural Causal Model and using th