optax.clip_by_global_norm

optax.clip_by_global_norm(max_norm: jax.typing.ArrayLike) → optax.GradientTransformation

Clips updates using their global norm.

Parameters:

max_norm – The maximum global norm for an update.

Returns:

A optax.GradientTransformation object.

References

Pascanu et al., On the difficulty of training Recurrent Neural Networks, 2012