For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).

Mojo function

build_sm100_matmul_configs

def build_sm100_matmul_configs[a_type: DType, b_type: DType, c_type: DType, N: Int, K: Int, transpose_b: Bool = True, has_epilogue_tensor: Bool = False, epilogue_is_1d: Bool = False]() -> Set[MatmulConfig[a_type, b_type, c_type, transpose_b]]

Build a set of MatmulConfig instances by sweeping M from 8 to 8192.

Parameters:

a_type (DType): DType of the A (left) operand elements; must equal b_type.
b_type (DType): DType of the B (right) operand elements.
c_type (DType): DType of the output matrix elements.
N (Int): The N dimension (output columns) of the matmul.
K (Int): The K dimension (contraction axis) of the matmul.
transpose_b (Bool): Whether the B operand is stored transposed (defaults to True).
has_epilogue_tensor (Bool): Whether the kernel uses a TMA epilogue load for an epilogue tensor (defaults to False).
epilogue_is_1d (Bool): Whether the epilogue tensor is 1D, for example a bias vector (defaults to False).

Returns:

Set[MatmulConfig[a_type, b_type, c_type, transpose_b]]: A set of unique MatmulConfig instances covering the swept M range.