tf.keras.experimental.CosineDecayRestarts
Stay organized with collections
Save and categorize content based on your preferences.
A LearningRateSchedule that uses a cosine decay schedule with restarts.
Inherits From: LearningRateSchedule
tf.keras.experimental.CosineDecayRestarts(
initial_learning_rate, first_decay_steps, t_mul=2.0, m_mul=1.0, alpha=0.0,
name=None
)
Args |
initial_learning_rate
|
A scalar float32 or float64 Tensor or a Python
number. The initial learning rate.
|
first_decay_steps
|
A scalar int32 or int64 Tensor or a Python
number. Number of steps to decay over.
|
t_mul
|
A scalar float32 or float64 Tensor or a Python number.
Used to derive the number of iterations in the i-th period
|
m_mul
|
A scalar float32 or float64 Tensor or a Python number.
Used to derive the initial learning rate of the i-th period:
|
alpha
|
A scalar float32 or float64 Tensor or a Python number.
Minimum learning rate value as a fraction of the initial_learning_rate.
|
name
|
String. Optional name of the operation. Defaults to 'SGDRDecay'.
|
Methods
from_config
View source
@classmethod
from_config(
config
)
Instantiates a LearningRateSchedule
from its config.
Args |
config
|
Output of get_config() .
|
Returns |
A LearningRateSchedule instance.
|
get_config
View source
get_config()
__call__
View source
__call__(
step
)
Call self as a function.
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2020-10-01 UTC.
[{
"type": "thumb-down",
"id": "missingTheInformationINeed",
"label":"Missing the information I need"
},{
"type": "thumb-down",
"id": "tooComplicatedTooManySteps",
"label":"Too complicated / too many steps"
},{
"type": "thumb-down",
"id": "outOfDate",
"label":"Out of date"
},{
"type": "thumb-down",
"id": "samplesCodeIssue",
"label":"Samples / code issue"
},{
"type": "thumb-down",
"id": "otherDown",
"label":"Other"
}]
[{
"type": "thumb-up",
"id": "easyToUnderstand",
"label":"Easy to understand"
},{
"type": "thumb-up",
"id": "solvedMyProblem",
"label":"Solved my problem"
},{
"type": "thumb-up",
"id": "otherUp",
"label":"Other"
}]
{"lastModified": "Last updated 2020-10-01 UTC."}
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Missing the information I need","missingTheInformationINeed","thumb-down"],["Too complicated / too many steps","tooComplicatedTooManySteps","thumb-down"],["Out of date","outOfDate","thumb-down"],["Samples / code issue","samplesCodeIssue","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2020-10-01 UTC."],[],[]]