View source on GitHub |
Builds an Adafactor optimizer.
tff.learning.optimizers.build_adafactor(
learning_rate: optimizer.Float,
*,
beta_2_decay: optimizer.Float = -0.8,
epsilon_1: optimizer.Float = 1e-30,
epsilon_2: optimizer.Float = 0.001,
clip_threshold: optimizer.Float = 1.0,
relative_step: bool = True
) -> tff.learning.optimizers.Optimizer
An implementation of Adafactor from Shazeer, Noam et al described in https://arxiv.org/abs/1804.04235
Returns | |
---|---|
A tff.learning.optimizers.Optimizer that implements the Adafactor
optimizer.
|