optax.contrib.SophiaState

Contents

optax.contrib.SophiaState#

class optax.contrib.SophiaState(count: jax.Array, mu: base.Updates, nu: base.Updates, hessian_fn_state: Any)[source]#

State for Sophia Optimizer.