Mojo module
ccl
comptime values
CCL_LIBRARY
comptime CCL_LIBRARY = _Global["CCL_LIBRARY", _init_ccl_dylib]
CCLAllGatherFn
comptime CCLAllGatherFn = fn(LegacyUnsafePointer[NoneType], LegacyUnsafePointer[NoneType], Int, ncclDataType_t, LegacyUnsafePointer[NoneType], LegacyUnsafePointer[NoneType]) -> ncclResult_t
CCLAllReduceFn
comptime CCLAllReduceFn = fn(LegacyUnsafePointer[NoneType], LegacyUnsafePointer[NoneType], Int, ncclDataType_t, ncclRedOp_t, LegacyUnsafePointer[NoneType], LegacyUnsafePointer[NoneType]) -> ncclResult_t
NCCL_LIBRARY_PATHS
comptime NCCL_LIBRARY_PATHS = List[Path]("libnccl.so", "libnccl.so.2", "/usr/lib/x86_64-linux-gnu/libnccl.so", "/usr/lib/x86_64-linux-gnu/libnccl.so.2", Tuple[]())
ncclComm_t
comptime ncclComm_t = LegacyOpaquePointer
RCCL_LIBRARY_PATHS
comptime RCCL_LIBRARY_PATHS = List[Path]("librccl.so", "librccl.so.1", "/opt/rocm/lib/librccl.so", "/opt/rocm/lib/librccl.so.1", Tuple[]())
Structs
Functions
-
allgather: -
allreduce: Per-GPU allreduce for use in multi-threaded contexts. -
group: -
init_comms: Pre-initialize NCCL/RCCL communicators. -
is_allgather_available: -
is_allreduce_available: -
ncclCommInitAll:
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!