Skip to main content

Mojo function

allgather

allgather[dtype: DType, inputs_origin: ImmutOrigin, outputs_origin: MutOrigin, //, rank: Int, ngpus: Int](inputs: InlineArray[NDBuffer[dtype, inputs_origin], ngpus], outputs: InlineArray[NDBuffer[dtype, outputs_origin], (ngpus * ngpus)], list_of_ctx: List[DeviceContext])

Was this page helpful?