For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).

Mojo function

dispatch_select_comm_config

def dispatch_select_comm_config[TuningTableType: CommTuningConfig, //, ngpus: Int, sm_version: StringSlice[StaticConstantOrigin], tuning_table: Table[TuningTableType]](num_bytes: Int) -> TuningTableType

This function searches for tuning configs with matching sm_version and ngpus. If such configs are found, then the search continues for finding the config x where num_bytes <= x.num_bytes.

Falls back to the arch-specific default (ngpus=-1, num_bytes=-1, matching sm_version), or if none exists, to the global default (ngpus=-1, num_bytes=-1, sm_version="default").

Returns:

TuningTableType