AdaDelta 1 Optimization techniques comparison in Julia: SGD, Momentum, Adagrad, Adadelta, Adam Jan 6, 2016