How to set parameters of the Adadelta Algorithm in Tensorflow correctly?
问题 I've been using Tensorflow for regression purposes. My neural net is very small with 10 input neurons, 12 hidden neurons in a single layer and 5 output neurons. activation function is relu cost is square distance between output and real value my neural net trains correctly with other optimizers such as GradientDescent, Adam, Adagrad. However when I try to use Adadelta, the neural net simply won't train. Variables stay the same at every step. I have tried with every initial learning_rate