AdaDelta 1 Optimization techniques comparison in Julia: SGD, Momentum, Adagrad, Adadelta, Adam Jan 5, 2016