For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).

Mojo module

packing

Structs

• ​BTileGenerator: Struct to encapsulate a tile of B that supports prepacking.
• ​PackMatrixCols: Pack columns from a matrix into the mlas packed layout and extract inner vectors of columns into the packed inner dimension, e.g. extracts [X, Y] and packs as [Yo][X][Yi].
• ​PackMatrixRows: Pack rows from a matrix into the mlas packed layout and extract inner vectors of rows into the packed inner dimension, e.g. extract tile [X, Y] and pack into [Xo][Y][Xi].

Functions

• ​pack_b: Utility function to pack the entire B matrix, such that each [tile_n // inner_size, tile_k, inner_size] tile of src is contiguous in dst.
• ​pack_b_ndbuffer: TileTensor primary implementation of pack_b_ndbuffer.
• ​pack_matmul_b_shape_func: TileTensor primary implementation of pack_matmul_b_shape_func.
• ​pack_transposed_b_ndbuffer: TileTensor primary implementation of pack_transposed_b_ndbuffer.

Was this page helpful?

Thank you! We'll create more content like this.

Thank you for helping us improve!

😔 What went wrong?

Some code doesn’t work

It includes inaccurate information

It's missing information I need

It was difficult to understand

Other

Submit