optax.scale_by_adadelta

optax.scale_by_adadelta#

optax.scale_by_adadelta(rho: jax.typing.ArrayLike = 0.9, eps: jax.typing.ArrayLike = 1e-06) → optax.GradientTransformation[source]#

Rescale updates according to the Adadelta algorithm.

See optax.adadelta() for more details.

Parameters:

  • rho – A coefficient used for computing a running average of squared gradients.

  • eps – Term added to the denominator to improve numerical stability.

Returns:

A optax.GradientTransformation object.