tf.distribute.in_cross_replica_context

TensorFlow 1 version View source on GitHub

Returns True if in a cross-replica context.

tf.distribute.in_cross_replica_context()

See tf.distribute.get_replica_context for details.

assert not tf.distribute.in_cross_replica_context()
with strategy.scope():
  assert tf.distribute.in_cross_replica_context()

  def f():
    assert not tf.distribute.in_cross_replica_context()

  strategy.experimental_run_v2(f)

True if in a cross-replica context (get_replica_context() returns None), or False if in a replica context (get_replica_context() returns non-None).