LSTM RNN Backpropagation

Question

Could someone give a clear explanation of backpropagation for LSTM RNNs? This is the type structure I am working with. My question is not posed at what is back propagation, I un

Answer 1

I think your questions could not be answered in a short response. Nico's simple LSTM has a link to a great paper from Lipton et.al., please read this. Also his simple python code sample helps to answer most of your questions. If you understand Nico's last sentence ds = self.state.o * top_diff_h + top_diff_s in detail, please give me a feed back. At the moment I have a final problem with his "Putting all this s and h derivations together".