DistributedCommunicationRoot
Value members
Abstract methods
Broadcast command to all peers (non root ranks)
Broadcast command to all peers (non root ranks)
- Value parameters:
- state
The value returned from
onNcclCliqueReady
Framework will call this when the nccl unique id is ready
Framework will call this when the nccl unique id is ready
Implementations should respond with this uid
to each peer who try to
join this clique after this call.
Returns a suspended side effect. Once the returned value is completed the implementation is ready to accept peers to its clique.