TensorFlow 1 version | View source on GitHub |
A LearningRateSchedule that uses a noisy linear cosine decay schedule.
Inherits From: LearningRateSchedule
tf.keras.experimental.NoisyLinearCosineDecay(
initial_learning_rate, decay_steps, initial_variance=1.0, variance_decay=0.55,
num_periods=0.5, alpha=0.0, beta=0.001, name=None
)
Args | |
---|---|
initial_learning_rate
|
A scalar float32 or float64 Tensor or a Python
number. The initial learning rate.
|
decay_steps
|
A scalar int32 or int64 Tensor or a Python number.
Number of steps to decay over.
|
initial_variance
|
initial variance for the noise. See computation above. |
variance_decay
|
decay for the noise's variance. See computation above. |
num_periods
|
Number of periods in the cosine part of the decay. See computation above. |
alpha
|
See computation above. |
beta
|
See computation above. |
name
|
String. Optional name of the operation. Defaults to 'NoisyLinearCosineDecay'. |
Methods
from_config
@classmethod
from_config( config )
Instantiates a LearningRateSchedule
from its config.
Args | |
---|---|
config
|
Output of get_config() .
|
Returns | |
---|---|
A LearningRateSchedule instance.
|
get_config
get_config()
__call__
__call__(
step
)
Call self as a function.