optax.schedules.join_schedules

optax.schedules.join_schedules(

schedules: Sequence[base.Schedule],

boundaries: Sequence[int],

) → base.Schedule

Sequentially apply multiple schedules.

Parameters:

• schedules – A list of callables (expected to be optax schedules). Each schedule will receive a step count indicating the number of steps since the previous boundary transition.

• boundaries – A list of integers (of length one less than schedules) that indicate when to transition between schedules.

Returns:

A function that maps step counts to values.

Return type:

schedule