Mojo module
device_query
Provides device query utilities for communication primitives.
comptime values
GB
comptime GB = 1073741824
KB
comptime KB = 1024
MB
comptime MB = 1048576
Structs
-
DefaultCommTuningConfig: Parameters: ngpus: Number of GPUs for running allreduce. num_bytes: Total number of input bytes supported by the config. sm_version: SM version (as string). num_blocks: Number of thread blocks for running allreduce.
Traits
Functions
-
dispatch_select_comm_config: This function searches for tuning configs with matching sm_version and ngpus. If such configs are found, then the search continues for finding the config x where num_bytes <= x.num_bytes. -
get_sm_version:
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!