How do I find a suitable loss function for a regression problem?

Question

I am trying to solve a nonlinear differential equation with a neural network. Lots of people are doing this, and they\'ve got pretty good results. I have defined a custom lo