IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /max/get-started.md). For the complete documentation index, see llms.txt.

Skip to main content

For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).

Mojo struct

IndexSmemStorage

struct IndexSmemStorage[dtype: DType, num_heads: Int, depth: Int, BN: Int]

Fields

q_smem (InlineArray[Scalar[dtype], (num_heads * depth)]):
k_smem (InlineArray[Scalar[dtype], (BN * depth)]):
scratch (InlineArray[Float32, (BN * 8)]):

Implemented traits

AnyType, ImplicitlyDeletable

Fields
Implemented traits