Creates a dataset that applies f
to the outputs of input_dataset
.
View aliases
Compat aliases for migration
See Migration guide for more details.
tf.raw_ops.ParallelInterleaveDatasetV2(
input_dataset,
other_arguments,
cycle_length,
block_length,
num_parallel_calls,
f,
output_types,
output_shapes,
sloppy=False,
metadata='',
name=None
)
The resulting dataset is similar to the InterleaveDataset
, except that the
dataset will fetch records from the interleaved datasets in parallel.
The tf.data
Python API creates instances of this op from
Dataset.interleave()
when the num_parallel_calls
parameter of that method
is set to any value other than None
.
By default, the output of this dataset will be deterministic, which may result
in the dataset blocking if the next data item to be returned isn't available.
In order to avoid head-of-line blocking, one can set the
experimental_deterministic
parameter of tf.data.Options
to False
,
which can improve performance at the expense of non-determinism.
Args | |
---|---|
input_
|
A Tensor of type variant .
Dataset that produces a stream of arguments for the function f .
|
other_
|
A list of Tensor objects.
Additional arguments to pass to f beyond those produced by input_ .
Evaluated once when the dataset is instantiated.
|
cycle_
|
A Tensor of type int64 .
Number of datasets (each created by applying f to the elements of
input_ ) among which the ParallelInterleaveDatasetV2 will cycle in a
round-robin fashion.
|
block_
|
A Tensor of type int64 .
Number of elements at a time to produce from each interleaved invocation of a
dataset returned by f .
|
num_
|
A Tensor of type int64 .
Determines the number of threads that should be used for fetching data from
input datasets in parallel. The Python API tf.data.experimental.AUTOTUNE
constant can be used to indicate that the level of parallelism should be autotuned.
|
f
|
A function decorated with @Defun.
A function mapping elements of input_ , concatenated with
other_ , to a Dataset variant that contains elements matching
output_ and output_ .
|
output_
|
A list of tf. that has length >= 1 .
|
output_
|
A list of shapes (each a tf.TensorShape or list of ints ) that has length >= 1 .
|
sloppy
|
An optional bool . Defaults to False .
|
metadata
|
An optional string . Defaults to "" .
|
name
|
A name for the operation (optional). |
Returns | |
---|---|
A Tensor of type variant .
|