For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).

Mojo struct

KBufferConfig

struct KBufferConfig[BN: Int, BK: Int, WN: Int]

K-role decode buffer config that iterates DRAM along the column axis.

The warp tile is [WN, BK] (key-block width by strip width), the block tile is [BN, BK], and iterator_axis = 1 advances tile_idx across column strips of the DRAM tile.

Parameters

BN (Int): Number of keys per block tile (extent along the key axis).
BK (Int): Strip width along the MMA K dimension.
WN (Int): Number of keys per warp tile.

Implemented traits

AnyType, ImplicitlyDeletable, KVBufferConfig

`comptime` members

`btile_dim0`

comptime btile_dim0 = BN

`btile_dim1`

comptime btile_dim1 = BK

`iterator_axis`

comptime iterator_axis = 1

`wsize`

comptime wsize = KBufferConfig[BN, BK, WN].wtile_dim0

`wtile_dim0`

comptime wtile_dim0 = WN

`wtile_dim1`

comptime wtile_dim1 = BK

Methods

`get_wtile_coord`

static def get_wtile_coord() -> IndexList[Int(2)]

Returns:

IndexList[Int(2)]

Parameters​

Implemented traits​

comptime members​

btile_dim0​

btile_dim1​

iterator_axis​

wsize​

wtile_dim0​

wtile_dim1​

Methods​

get_wtile_coord​