IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.

Skip to main content

For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo package

cpu

CPU flash-attention implementation for multi-head attention.

Modules

mha: Implements CPU-based multi-head attention kernels, including flash attention and KV-cache-backed attention variants.

Modules