optax.schedules.join_schedules

optax.schedules.join_schedules(schedules: Sequence[base.Schedule], boundaries: Sequence[int]) → base.Schedule

Sequentially apply multiple schedules.

Parameters:

• schedules – A list of callables (expected to be optax schedules). Each schedule will receive a step count indicating the number of steps since the previous boundary transition.

• boundaries – A list of integers (of length one less than schedules) that indicate when to transition between schedules.

Returns:

A function that maps step counts to values.

Return type:

schedule