tf.keras.experimental.NoisyLinearCosineDecay

TensorFlow 2 version View source on GitHub

A LearningRateSchedule that uses a noisy linear cosine decay schedule.

Inherits From: LearningRateSchedule

tf.keras.experimental.NoisyLinearCosineDecay(
    initial_learning_rate, decay_steps, initial_variance=1.0, variance_decay=0.55,
    num_periods=0.5, alpha=0.0, beta=0.001, name=None
)

initial_learning_rate A scalar float32 or float64 Tensor or a Python number. The initial learning rate.
decay_steps A scalar int32 or int64 Tensor or a Python number. Number of steps to decay over.
initial_variance initial variance for the noise. See computation above.
variance_decay decay for the noise's variance. See computation above.
num_periods Number of periods in the cosine part of the decay. See computation above.
alpha See computation above.
beta See computation above.
name String. Optional name of the operation. Defaults to 'NoisyLinearCosineDecay'.

Methods

from_config

View source

@classmethod
from_config(
    config
)

Instantiates a LearningRateSchedule from its config.

Args
config Output of get_config().

Returns
A LearningRateSchedule instance.

get_config

View source

get_config()

__call__

View source

__call__(
    step
)

Call self as a function.