Mojo module
ccl
comptime values
CCL_LIBRARY
comptime CCL_LIBRARY = _Global["CCL_LIBRARY", _init_ccl_dylib]
NCCL_LIBRARY_PATHS
comptime NCCL_LIBRARY_PATHS = List(VariadicList("libnccl.so", "libnccl.so.2", "/usr/lib/x86_64-linux-gnu/libnccl.so", "/usr/lib/x86_64-linux-gnu/libnccl.so.2"), Tuple())
ncclComm_t
comptime ncclComm_t = UnsafePointer[NoneType, MutAnyOrigin]
RCCL_LIBRARY_PATHS
comptime RCCL_LIBRARY_PATHS = List(VariadicList("librccl.so", "librccl.so.1", "/opt/rocm/lib/librccl.so", "/opt/rocm/lib/librccl.so.1"), Tuple())
Structs
Functions
-
allgather: -
allreduce: Per-GPU allreduce for use in multi-threaded contexts. -
broadcast: Per-GPU broadcast for use in multi-threaded contexts. -
group: -
init_comms: Pre-initialize NCCL/RCCL communicators. -
is_allgather_available: -
is_allreduce_available: -
is_broadcast_available: -
ncclCommInitAll:
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!