Is my implementation of stochastic gradient descent correct?

Question

I am trying to develop stochastic gradient descent, but I don\'t know if it is 100% correct.

• The cost generated by my stochastic gradient descent algorithm is

Answer 1

The learning rate is always between 0 to 1. If you set the learning rate very high then it follows the desired to a lesser extent, because of skipping. So take a small learning rate even though it takes more time. The output result will be more convincing.