Mojo module
ccl
comptime valuesβ
CCL_LIBRARYβ
comptime CCL_LIBRARY = _Global[StringSlice("CCL_LIBRARY"), _init_ccl_dylib]
NCCL_LIBRARY_PATHSβ
comptime NCCL_LIBRARY_PATHS = List(Path("libnccl.so"), Path("libnccl.so.2"), Path("/usr/lib/x86_64-linux-gnu/libnccl.so"), Path("/usr/lib/x86_64-linux-gnu/libnccl.so.2"), __list_literal__=NoneType(None))
ncclComm_tβ
comptime ncclComm_t = Optional[UnsafePointer[NoneType, MutAnyOrigin]]
RCCL_LIBRARY_PATHSβ
comptime RCCL_LIBRARY_PATHS = List(Path("librccl.so"), Path("librccl.so.1"), Path("/opt/rocm/lib/librccl.so"), Path("/opt/rocm/lib/librccl.so.1"), __list_literal__=NoneType(None))
Structsβ
Functionsβ
- β
allgather: - β
allreduce: Per-GPU allreduce for use in multi-threaded contexts. - β
broadcast: Per-GPU broadcast for use in multi-threaded contexts. - β
group: - β
init_comms: Pre-initialize NCCL/RCCL communicators. - β
is_allgather_available: - β
is_allreduce_available: - β
is_broadcast_available: - β
ncclCommInitAll: - β
wait_for_comms: Spin-wait until communicators for ngpus have been initialized.
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!