TensorFlow 1 version | View source on GitHub |
A LearningRateSchedule that uses a linear cosine decay schedule.
Inherits From: LearningRateSchedule
tf.keras.experimental.LinearCosineDecay(
initial_learning_rate, decay_steps, num_periods=0.5, alpha=0.0, beta=0.001,
name=None
)
Args | |
---|---|
initial_learning_rate
|
A scalar float32 or float64 Tensor or a Python
number. The initial learning rate.
|
decay_steps
|
A scalar int32 or int64 Tensor or a Python number.
Number of steps to decay over.
|
num_periods
|
Number of periods in the cosine part of the decay. See computation above. |
alpha
|
See computation above. |
beta
|
See computation above. |
name
|
String. Optional name of the operation. Defaults to 'LinearCosineDecay'. |
Methods
from_config
@classmethod
from_config( config )
Instantiates a LearningRateSchedule
from its config.
Args | |
---|---|
config
|
Output of get_config() .
|
Returns | |
---|---|
A LearningRateSchedule instance.
|
get_config
get_config()
__call__
__call__(
step
)
Call self as a function.