Classes
class CosineDecay
: A LearningRateSchedule that uses a cosine decay with optional warmup.
class CosineDecayRestarts
: A LearningRateSchedule that uses a cosine decay schedule with restarts.
class ExponentialDecay
: A LearningRateSchedule that uses an exponential decay schedule.
class InverseTimeDecay
: A LearningRateSchedule that uses an inverse time decay schedule.
class LearningRateSchedule
: The learning rate schedule base class.
class PiecewiseConstantDecay
: A LearningRateSchedule that uses a piecewise constant decay schedule.
class PolynomialDecay
: A LearningRateSchedule that uses a polynomial decay schedule.
Functions
deserialize(...)
: Instantiates a LearningRateSchedule
object from a serialized form.
serialize(...)
: Serializes a LearningRateSchedule
into a JSON-compatible dict.