SHOGUN  6.0.0
Classes
AdaDeltaUpdater.h File Reference

Go to the source code of this file.

Classes

class  AdaDeltaUpdater
 The class implements the AdaDelta method.

\[ \begin{array}{l} g_\theta=(1-\lambda){(\frac{ \partial f(\cdot) }{\partial \theta })}^2+\lambda g_\theta\\ d_\theta=\alpha\frac{\sqrt{s_\theta+\epsilon}}{\sqrt{g_\theta+\epsilon}}\frac{ \partial f(\cdot) }{\partial \theta }\\ s_\theta=(1-\lambda){(d_\theta)}^2+\lambda s_\theta \end{array} \]

. More...

 

SHOGUN Machine Learning Toolbox - Documentation