For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo module
mla_decode_sparse
Implements the sparse MLA decoding kernel for SM100 (Blackwell) GPUs.
Provides the MLA_SM100_Decode_Sparse struct, a sparse-attention variant of
the SM100 MLA decode kernel that loads KV cache tiles via gather4 TMA using
per-tile sparse indices, with FP8-to-BF16 conversion in shared memory before
UMMA consumption.
Structs
-
MLA_SM100_Decode_Sparse: Sparse MLA decoding kernel for SM100 with FP8 KV cache and gather4 TMA.