tf.raw_ops.CollectiveAllToAllV2

Mutually exchanges multiple tensors of identical type and shape.

tf.raw_ops.CollectiveAllToAllV2(
    input,
    group_size,
    group_key,
    instance_key,
    ordering_token,
    communication_hint='auto',
    timeout_seconds=0,
    is_stateless=False,
    name=None
)

is_stateless means each op does not need control dependencies to other collective ops. In this case, keys that are unique at runtime (e.g. instance_key) should be used to distinguish collective groups.

inputA Tensor. Must be one of the following types: bfloat16, float32, half, float64, int32, int64.
group_sizeA Tensor of type int32.
group_keyA Tensor of type int32.
instance_keyA Tensor of type int32.
ordering_tokenA list of Tensor objects with type resource.
communication_hintAn optional string. Defaults to "auto".
timeout_secondsAn optional float. Defaults to 0.
is_statelessAn optional bool. Defaults to False.
nameA name for the operation (optional).

A Tensor. Has the same type as input.