For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).
Mojo function
get_partitioned_matmul_mojo_shape
def get_partitioned_matmul_mojo_shape[b_type: DType, kernel_rows: Int, kernel_cols: Int, use_i8mm: Bool](m: Int, n: Int, k: Int, num_tasks: Int) -> IndexList[Int(2)]
Returns the row and column task counts that best balance a parallel matmul.
Searches over feasible task grids and selects the one that minimizes the
per-task work, with heuristics for small m and L2-cache-aware column
partitioning.
Parameters:
- βb_type (
DType): The dtype of the B tensor. - βkernel_rows (
Int): The static number of rows of the micro kernel. - βkernel_cols (
Int): The static number of columns of the micro kernel. - βuse_i8mm (
Bool): Whether the i8mm instruction is available on the target.
Args:
- βm (
Int): The M dimension of the matmul. - βn (
Int): The N dimension of the matmul. - βk (
Int): The K dimension of the matmul. - βnum_tasks (
Int): The total number of tasks sharing the matmul.
Returns:
IndexList[Int(2)]: A pair (num_row_tasks, num_col_tasks) describing the task grid.
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!