Mojo module

ccl

`comptime` values

`CCL_LIBRARY`

comptime CCL_LIBRARY = _Global[StringSlice("CCL_LIBRARY"), _init_ccl_dylib]

`NCCL_LIBRARY_PATHS`

comptime NCCL_LIBRARY_PATHS = List(Path("libnccl.so"), Path("libnccl.so.2"), Path("/usr/lib/x86_64-linux-gnu/libnccl.so"), Path("/usr/lib/x86_64-linux-gnu/libnccl.so.2"), __list_literal__=Tuple())

`ncclComm_t`

comptime ncclComm_t = Optional[NonNullUnsafePointer[NoneType, MutAnyOrigin]]

`RCCL_LIBRARY_PATHS`

comptime RCCL_LIBRARY_PATHS = List(Path("librccl.so"), Path("librccl.so.1"), Path("/opt/rocm/lib/librccl.so"), Path("/opt/rocm/lib/librccl.so.1"), __list_literal__=Tuple())

Structs

Functions

allgather:
allreduce: Per-GPU allreduce for use in multi-threaded contexts.
broadcast: Per-GPU broadcast for use in multi-threaded contexts.
group:
init_comms: Pre-initialize NCCL/RCCL communicators.
is_allgather_available:
is_allreduce_available:
is_broadcast_available:
ncclCommInitAll:
wait_for_comms: Spin-wait until communicators for ngpus have been initialized.

comptime values​

CCL_LIBRARY​

NCCL_LIBRARY_PATHS​

ncclComm_t​

RCCL_LIBRARY_PATHS​

Structs​

Functions​